-- Logs begin at Mon 2022-01-24 08:25:58 UTC, end at Mon 2022-01-24 09:37:07 UTC. -- Jan 24 09:08:20.775005 dv-cinder-804035-26-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 24 09:08:20.784210 dv-cinder-804035-26-iscsi devstack@n-api.service[102358]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 24 09:08:20.785738 dv-cinder-804035-26-iscsi devstack@n-api.service[102358]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jan 24 09:08:20 2022] *** Jan 24 09:08:20.785738 dv-cinder-804035-26-iscsi devstack@n-api.service[102358]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 24 09:08:20.785738 dv-cinder-804035-26-iscsi devstack@n-api.service[102358]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 24 09:08:20.785738 dv-cinder-804035-26-iscsi devstack@n-api.service[102358]: nodename: dv-cinder-804035-26-iscsi Jan 24 09:08:20.785738 dv-cinder-804035-26-iscsi devstack@n-api.service[102358]: machine: x86_64 Jan 24 09:08:20.785738 dv-cinder-804035-26-iscsi devstack@n-api.service[102358]: clock source: unix Jan 24 09:08:20.785738 dv-cinder-804035-26-iscsi devstack@n-api.service[102358]: pcre jit disabled Jan 24 09:08:20.785738 dv-cinder-804035-26-iscsi devstack@n-api.service[102358]: detected number of CPU cores: 4 Jan 24 09:08:20.785738 dv-cinder-804035-26-iscsi devstack@n-api.service[102358]: current working directory: / Jan 24 09:08:20.785738 dv-cinder-804035-26-iscsi devstack@n-api.service[102358]: detected binary path: /usr/bin/uwsgi-core Jan 24 09:08:20.787070 dv-cinder-804035-26-iscsi devstack@n-api.service[102358]: your processes number limit is 47680 Jan 24 09:08:20.787070 dv-cinder-804035-26-iscsi devstack@n-api.service[102358]: your memory page size is 4096 bytes Jan 24 09:08:20.787070 dv-cinder-804035-26-iscsi devstack@n-api.service[102358]: detected max file descriptor number: 2048 Jan 24 09:08:20.787070 dv-cinder-804035-26-iscsi devstack@n-api.service[102358]: lock engine: pthread robust mutexes Jan 24 09:08:20.787070 dv-cinder-804035-26-iscsi devstack@n-api.service[102358]: thunder lock: enabled Jan 24 09:08:20.787070 dv-cinder-804035-26-iscsi devstack@n-api.service[102358]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 24 09:08:20.787070 dv-cinder-804035-26-iscsi devstack@n-api.service[102358]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 24 09:08:20.832488 dv-cinder-804035-26-iscsi devstack@n-api.service[102358]: Python main interpreter initialized at 0x55cab5b5b9c0 Jan 24 09:08:20.832488 dv-cinder-804035-26-iscsi devstack@n-api.service[102358]: python threads support enabled Jan 24 09:08:20.832488 dv-cinder-804035-26-iscsi devstack@n-api.service[102358]: your server socket listen backlog is limited to 100 connections Jan 24 09:08:20.832488 dv-cinder-804035-26-iscsi devstack@n-api.service[102358]: your mercy for graceful operations on workers is 90 seconds Jan 24 09:08:20.832868 dv-cinder-804035-26-iscsi devstack@n-api.service[102358]: mapped 403077 bytes (393 KB) for 2 cores Jan 24 09:08:20.832955 dv-cinder-804035-26-iscsi devstack@n-api.service[102358]: *** Operational MODE: preforking *** Jan 24 09:08:20.833323 dv-cinder-804035-26-iscsi devstack@n-api.service[102358]: *** uWSGI is running in multiple interpreter mode *** Jan 24 09:08:20.833323 dv-cinder-804035-26-iscsi devstack@n-api.service[102358]: spawned uWSGI master process (pid: 102358) Jan 24 09:08:20.833573 dv-cinder-804035-26-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 24 09:08:20.834291 dv-cinder-804035-26-iscsi devstack@n-api.service[102358]: spawned uWSGI worker 1 (pid: 102359, cores: 1) Jan 24 09:08:20.834462 dv-cinder-804035-26-iscsi devstack@n-api.service[102358]: spawned uWSGI worker 2 (pid: 102360, cores: 1) Jan 24 09:08:20.834603 dv-cinder-804035-26-iscsi devstack@n-api.service[102358]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 24 09:08:22.667292 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 24 09:08:22.667292 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: from cryptography.utils import int_from_bytes Jan 24 09:08:22.667982 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 24 09:08:22.667982 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: from cryptography.utils import int_from_bytes Jan 24 09:08:22.668126 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 24 09:08:22.668126 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: from cryptography.utils import int_from_bytes Jan 24 09:08:22.668572 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 24 09:08:22.668572 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: from cryptography.utils import int_from_bytes Jan 24 09:08:25.294051 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 24 09:08:25.294696 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 24 09:08:25.294798 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 24 09:08:25.295148 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 24 09:08:25.295222 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 24 09:08:25.295296 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 24 09:08:25.295370 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 24 09:08:25.295436 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 24 09:08:25.295674 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 24 09:08:25.295771 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.295926 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 24 09:08:25.296102 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.296309 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.296430 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.296634 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.296754 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.296954 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.297090 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.297271 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.297405 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.297599 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.297738 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.297911 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.298058 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.298253 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.298420 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.298569 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.298684 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.298895 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.299005 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.299152 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.299334 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804035-26-iscsi {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.299467 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.299660 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.299790 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804035-26-iscsi {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.299973 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.300110 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.300286 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.300422 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.300610 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.300727 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.300917 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.301040 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.301247 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.301367 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.301562 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.301659 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.302573 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.302694 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.303085 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.303240 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.303400 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.303550 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.303685 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.303833 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.304034 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.304176 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.304355 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.304480 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.304669 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.304812 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.304995 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.305125 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.305310 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.305458 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.305619 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.305755 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.305941 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.306069 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.306290 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.306395 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804035-26-iscsi {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.306668 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804035-26-iscsi {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.306754 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.306982 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.307073 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.307295 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.307378 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.307605 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.307747 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.308015 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.308112 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.308324 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.308415 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.308630 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.308716 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.308948 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.309034 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.309264 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.309348 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.309569 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.309659 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.309894 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.309978 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.310236 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.310325 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.310557 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.310657 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.310864 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.310991 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.311163 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.311254 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.311471 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.311575 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.311775 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.311868 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.312091 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.312217 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.312389 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.312487 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.312639 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.312725 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.312925 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.313022 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.313231 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.313318 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.313553 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.313639 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.313872 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.313987 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.314149 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.314271 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.314407 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.314508 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.314685 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.314807 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.315004 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.315097 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.315323 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.315423 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.315636 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.315744 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.315948 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.316047 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.316248 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.316349 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.316552 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.316638 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.316856 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.316944 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.317160 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.317248 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.317613 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.317707 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.317987 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.318080 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.318336 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.318438 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.318648 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.318733 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.318968 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.319080 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.319273 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.319360 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.319591 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.319676 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.113 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.319927 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.113 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.320020 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.113 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.320223 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.113 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.320316 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.320531 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.320618 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.320869 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.320960 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.321188 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.321282 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.321492 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.321578 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.321811 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.321907 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.322150 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.322246 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.322460 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.322547 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.322764 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.322860 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.323069 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.323157 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.323386 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.323472 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.323708 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.323801 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.323966 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.324053 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.324247 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.324333 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.324546 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.324640 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.324849 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.324935 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.325165 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.325259 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.325470 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.325557 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.325778 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.325861 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.326080 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.326189 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.326398 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.326492 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.326701 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.326787 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.327006 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.327091 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.327309 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.327396 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.327865 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.327952 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.328171 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.328267 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.328472 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.328566 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.328780 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.328871 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.329079 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.329164 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.329382 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.329479 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.329697 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.329782 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.330009 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.330134 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.330347 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.330444 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.330657 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.330750 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.330968 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.331109 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.331278 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.331366 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.331599 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.331692 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.331902 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.331987 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.332206 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.332342 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.332521 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.332613 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.332824 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.332918 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.333180 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.333310 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.333491 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.333791 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.333877 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.334119 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.334211 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.334431 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.334517 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.334740 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.334824 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.335041 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.335127 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.335347 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.335432 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.335655 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.335738 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.335961 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.336054 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.336267 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.336356 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.336571 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.336666 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.336874 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.336959 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.337177 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.337260 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.337476 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.337568 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.337776 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.337859 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.338073 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.338177 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.338396 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.338498 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.338714 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.338800 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.339031 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.339115 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.339336 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.339429 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.339640 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.339727 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.339942 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.340028 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.340259 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:08:25.340354 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.340591 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.340676 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.340921 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.341013 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.341261 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.341348 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.341575 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.341674 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.341907 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.342005 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.342247 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.342337 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.342566 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.342653 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.342875 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.342974 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.343187 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.343280 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.343501 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.343585 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.343809 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.343907 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.344120 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.344207 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.344429 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.344515 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.344745 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.344840 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.345061 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.345171 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.345381 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.345476 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.345706 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.345802 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.346024 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.346137 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.346374 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.346462 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.346686 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.346785 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.347002 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.347089 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.347327 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.347411 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.347644 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.347740 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.347955 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.348048 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.348297 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.348406 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.349153 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.349256 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.349497 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.349604 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.349879 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.349966 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.350228 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.350320 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.350550 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.350638 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.350867 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.350960 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.351178 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.351305 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.351488 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.351574 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.351815 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.351908 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.352125 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.352211 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.352435 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.352564 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.352770 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.352858 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.353080 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.353166 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.353392 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.353479 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.353692 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.353786 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.353995 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.354081 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.354319 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.354406 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.354629 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.354727 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.354932 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.355020 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.355251 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.355339 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.355576 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.355672 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.355882 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.355969 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.356197 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.356283 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.356506 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.356604 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.356816 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.356903 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.357122 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.357207 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.357427 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.357522 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.357730 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.357817 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.358036 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.358152 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.358368 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.358454 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.358673 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.358760 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.358991 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.359075 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.359299 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.359448 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.359603 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.359699 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.359911 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.360004 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.360213 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.360337 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.360516 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.360602 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.360828 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.360929 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.361137 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.361225 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.361446 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.361538 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.361755 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.361851 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.362072 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.362243 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.362403 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.362490 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.362711 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.362810 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.363057 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.363142 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.363389 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.363475 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.363693 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.363787 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.364018 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.364105 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.364904 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.365005 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.365331 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.365504 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.365651 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.365816 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.365966 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.366163 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.366298 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.366471 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.366616 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.366774 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.366930 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.367078 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.367243 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.367388 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.367557 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.367691 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.367869 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.367995 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.368179 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.368299 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.368509 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.368596 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.368825 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.368919 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.369137 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.369224 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.369448 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.369533 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.369759 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.369855 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.370076 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.370224 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.370407 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.370493 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.370752 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.370852 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.371056 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.371199 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.371397 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.371519 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.371744 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.371855 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.372045 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.372162 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.372365 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.372486 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.372679 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.372818 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.372994 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.373109 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.373304 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.373428 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.373614 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.373746 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.373923 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.374071 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.374257 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.374420 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.374574 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.374746 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.374886 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.375061 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.375204 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.375392 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.375514 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.375709 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.375837 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.376034 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.376152 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.376345 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.376472 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.376666 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.376775 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.377012 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.377098 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.377351 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.377438 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.377676 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.377762 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.378004 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.378137 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.378345 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.378442 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.378668 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.378761 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.378980 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.379066 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.379287 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.379373 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.379598 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.379685 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.379935 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.380023 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.380330 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.380438 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.380574 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.380711 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.380885 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.381022 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.381200 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.381341 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.381530 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.381652 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.381847 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.381945 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.382198 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.382292 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.382508 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.382594 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.382827 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.382930 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.383159 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.383246 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.383490 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.383581 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.383804 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.383899 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.384118 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.384203 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.384431 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.384518 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.384742 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.384829 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.385048 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.385141 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.385355 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.385441 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.385662 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.385756 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.385968 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.386054 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.386295 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.386382 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.386603 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.386691 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.386916 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.387001 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.387222 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.387314 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.387528 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.387615 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.387829 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.387922 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.388140 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.388227 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.388445 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.388532 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.388745 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.388830 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.389048 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.389213 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.389357 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.389443 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.389670 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.389777 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.389978 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.390082 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.390319 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.390407 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.390631 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.390717 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.390933 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.391031 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.391235 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.391329 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.391553 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.391639 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.391860 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.392005 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.392149 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.392311 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.392456 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.392587 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.392726 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.392862 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.393062 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.393223 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.393357 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.393494 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.393661 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.393794 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.393977 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.394138 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.394319 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.394458 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.394629 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.394766 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.394943 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.395086 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.395238 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.395374 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.395677 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.395894 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.396073 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.396225 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.396360 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.396510 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.396645 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.396779 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.396918 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.397052 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.397200 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.397349 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.397494 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.397628 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.397768 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.397902 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.398084 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.398319 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.398458 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.398741 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.399049 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.399351 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.399659 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.399808 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.399975 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.400112 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.400334 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.400548 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.400720 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.400947 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.401369 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.401511 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.401726 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.402047 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.402275 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.402420 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.402633 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.402734 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.402968 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.403091 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.403304 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.403393 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.403618 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.403704 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.403930 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.404024 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.404239 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.404326 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.404544 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.404631 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.404855 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.404952 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.405160 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.405248 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.405467 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.405554 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.405779 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.405882 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.406089 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.406263 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.406413 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.406743 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.406828 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.407061 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.407354 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.407501 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.407668 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.407962 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.408095 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.408270 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.408557 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.408696 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.408882 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.409014 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.409190 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.409330 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.409493 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.409633 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.409899 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.410038 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.410246 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.410540 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.410671 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.410881 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.411763 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.411863 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.412111 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.412875 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.413018 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.413179 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.413313 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.413449 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.413592 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.413727 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.413873 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.414014 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.414183 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.414327 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.414460 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.414607 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.414750 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.414882 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.415018 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.415161 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.415294 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.415424 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.415424 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.415678 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.415808 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.415937 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.416066 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.416240 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.416385 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.416523 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.416665 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.416802 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.416938 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.417082 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.417218 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.417349 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.417478 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.417615 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.417767 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.417906 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.418036 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.418233 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.418381 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.418515 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.418651 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.418797 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.418932 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.419064 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.419203 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.419337 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.419470 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.419611 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.419744 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.419879 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.420021 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.420180 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.420326 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.420502 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.420640 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.420819 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.420910 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.421131 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.421277 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.421442 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.421579 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.421762 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.421907 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.422066 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.422237 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.422399 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.422531 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.422707 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.422838 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.423016 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.423159 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.423335 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.423462 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.423635 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.423733 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.423939 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.424026 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.424246 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.424332 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.424549 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.424634 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.424852 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.424937 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.425159 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.425243 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.425480 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.425565 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.425795 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.425880 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.426106 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.426193 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.426422 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.426520 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.426773 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.427430 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.427581 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.427666 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.427894 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.427990 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.428209 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.428294 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.428543 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.428636 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.428843 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.428936 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.429149 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.429235 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.429454 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.429546 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.429757 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.429857 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.430065 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.430186 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.430400 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.430496 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.430700 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.430801 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.431008 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.431163 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.431304 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.431439 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.431607 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.431744 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.431917 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.432055 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.432227 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.432371 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.432555 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.432705 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.432867 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.432997 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.433180 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.433314 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.433489 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.433588 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.433794 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.433879 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.434141 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.434231 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.434429 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.434526 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.434745 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.434832 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.435055 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.435151 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.435367 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.435520 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.435998 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.436115 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.436237 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.436356 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.436462 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.436565 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.436668 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.436779 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.436882 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.436998 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.437178 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.437305 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.437499 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.437611 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.437822 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.437949 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.438144 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.438274 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.438455 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.438575 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.438768 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.438888 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.439075 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.439195 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.439385 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.439504 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.439692 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.439812 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.440003 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.440114 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.440314 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.440434 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.440621 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.440735 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.440931 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.441043 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.441239 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.441352 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.441545 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.441665 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.441853 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.441965 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.442181 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.442296 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.443120 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.443229 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.443333 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.443436 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.443570 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.443677 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.443787 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.443891 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.444017 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.444123 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.444236 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.444341 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.444444 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.444559 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.444671 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.444775 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.444934 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.445198 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.445298 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.445511 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.445599 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.445828 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.445924 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.446151 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.446258 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.446465 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.446551 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.446780 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.446868 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.447089 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.447174 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.447402 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.447530 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.447706 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.447849 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.448121 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.448207 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.448433 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.448519 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.448743 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.448831 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.449053 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.449139 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.449357 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.449443 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.449660 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.449763 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.449969 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.450063 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.450316 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.450415 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.450620 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.450731 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.450923 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.451052 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.451225 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.451371 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.451547 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.451683 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.451849 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.451992 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.452170 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.452308 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.452835 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.452929 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.453143 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.453231 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.453446 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.453543 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.453798 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.453884 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.454149 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.454242 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.454462 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.454552 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.454786 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.454919 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.455110 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.455200 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.455432 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.455522 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.455740 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.455827 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.456053 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.456219 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.456361 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.456539 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.456685 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.456858 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.457007 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.457190 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.457316 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.457521 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.457618 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.457852 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.457939 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.458855 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.458945 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.459184 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.459283 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.459504 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.459592 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.459839 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.459927 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.460173 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.460261 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.460492 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.460579 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.460837 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.460931 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.461113 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.461203 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.461444 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.461592 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.461774 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.461875 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.462086 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.462275 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.462421 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.462512 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.462729 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.462849 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.463035 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.463181 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.463359 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.463500 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.463666 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.463836 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.463977 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.464173 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.464289 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.464490 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.464598 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.464805 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.464894 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.465126 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.465237 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.465438 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.465526 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.465751 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.465839 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.466080 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.466227 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.466417 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.466505 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.466736 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.466832 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.467054 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.467140 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.467359 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.467456 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.467670 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.467775 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.467979 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.468064 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.468283 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.468383 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.468587 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.468726 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.468892 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.468980 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.469224 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.469327 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.469527 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.469613 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.469847 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.469940 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.470193 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.470295 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.470522 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.470615 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.470838 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.470972 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.471144 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.471242 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.471455 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.471542 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.471781 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.471965 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.472173 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.472260 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.472399 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.472527 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.472702 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.472859 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.473007 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.473199 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.473317 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.473539 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.473667 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.474586 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.474704 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.474924 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.475011 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.475239 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.475347 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.475544 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.475648 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.475854 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.475956 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.476159 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.476260 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.476483 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.476589 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.476787 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.476882 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.477103 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.477196 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.477409 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.477503 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.477713 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.477814 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.478016 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.478147 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.478346 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.478441 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.478665 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.478758 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.478979 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.479072 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.479290 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.479384 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.479615 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.479699 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.479924 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.480016 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.480254 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.480340 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.480565 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.480650 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.480874 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.480967 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.481186 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.481271 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.481496 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.481581 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.481808 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.481900 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.482144 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.482248 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.482461 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.482547 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.482776 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.482871 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.483091 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.483177 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.483401 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.483485 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.483714 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.483800 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.484029 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.484114 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.484345 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.484431 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.484678 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.484899 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.484997 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.485238 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.485333 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.485538 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.485650 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.485853 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.485940 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.486185 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.486272 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.486503 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.486591 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.486814 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.486899 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.487127 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.487214 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.487437 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.487530 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.487746 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.488027 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.488113 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.488360 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.488454 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.488680 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.488773 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.488999 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.489085 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.489340 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.489461 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.489664 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.489845 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.490037 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.490157 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.490326 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.490458 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.490642 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.490774 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.490959 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.491133 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.491276 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.491451 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.491608 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.491760 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.491934 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.492077 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.492266 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.492393 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.492606 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.492693 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.492927 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.493022 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.493248 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.493334 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.493570 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.493656 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.493889 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.493976 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.494218 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.494318 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.494532 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.494619 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.494845 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.494940 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.495160 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.495260 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.495523 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.495632 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.495811 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.495896 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.496129 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.496225 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.496443 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.496531 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.496758 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.496851 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.497073 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.497157 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.497390 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.497588 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.497709 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.497907 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.498030 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.498277 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.498365 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.498609 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.498696 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.498938 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.499023 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.499256 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.499349 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.499578 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.499663 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.499910 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.499994 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.500220 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.500314 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.500526 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.500764 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.500849 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.501088 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.501172 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.501427 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.501513 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.501751 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.501836 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.502064 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.502208 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.502393 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.502482 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.502713 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.502806 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.503026 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.503119 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.503352 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.503553 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.503664 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.503903 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.503988 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.504221 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.504308 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.504548 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.504635 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.504922 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.505014 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.505239 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.505378 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.505634 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.505744 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.505869 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.506026 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.506210 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.506365 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.506674 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.506765 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.506992 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.507088 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.507308 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.507393 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.507617 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.507725 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.507924 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.508059 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.508236 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.508383 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.508550 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.508700 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.508857 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.509034 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.509170 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.509349 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.509475 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.509664 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.509803 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.509988 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.510128 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.510332 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.510438 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.510646 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.510760 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.510961 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.511046 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.511279 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.511363 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.511596 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.511690 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.511907 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.511994 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.512219 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.512304 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.512527 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.512620 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.512832 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.512919 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.513144 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.513228 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.513448 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.513534 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.513757 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.513841 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.514061 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.514175 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.514393 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.514483 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.514697 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.514781 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.515007 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.515097 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.515316 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.515401 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.515745 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.515847 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.515927 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.516003 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.516234 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.516321 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.516545 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.516630 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.516856 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.516947 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.517165 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.517251 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.517484 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.517570 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.517796 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.517894 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.518146 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.518404 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.518491 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.518740 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.518825 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.519064 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.519150 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.519380 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.519465 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.519712 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.519803 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.520017 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.520103 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.520326 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.520410 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.521226 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.521317 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.521555 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.521654 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.521966 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.522229 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.522319 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.522579 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.522667 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.522911 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.523003 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.523222 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.523306 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.523534 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.523621 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.523846 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.523930 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.524158 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.524243 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.524470 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.524557 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.524781 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.524874 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.525098 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.525192 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.525420 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.525505 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.525860 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.525962 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.526042 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.526154 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.526388 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.526475 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.526704 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.526790 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.527015 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.527107 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.527329 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.527421 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.527641 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.527726 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.527950 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.528036 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.528268 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.528356 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.528598 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.528685 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.528912 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.528999 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.529220 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.529304 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.529546 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.529631 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.529874 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.529960 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.530218 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.530309 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.530540 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.530636 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.530859 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.530944 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.531178 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.531272 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.531501 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.531608 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.531811 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.531903 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.532130 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.532215 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.532440 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.532598 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.532767 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.532858 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.533106 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.533198 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.533433 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.533525 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.533757 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.533844 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.534063 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.534164 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.534390 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.534483 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.534694 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.534781 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.535002 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.535100 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.535333 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.535426 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.535665 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.535756 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.535981 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.536148 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.536897 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.537177 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.537335 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.537531 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.537631 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.537844 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.537983 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.538178 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.538358 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.538493 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.538719 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.538820 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.539076 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.539170 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.539421 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.539507 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.539754 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.539848 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.540084 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.540168 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.540402 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.540488 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.540732 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.540818 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.541048 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.541134 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.541371 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.541456 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.541696 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.541782 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.542014 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.542116 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.542359 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.542445 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.542699 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.542795 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.543015 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.543100 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.543333 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.543418 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.543649 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.543736 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.543965 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.544102 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.544279 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.544379 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.544596 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.544681 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.544927 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.545011 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.545247 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.545344 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.545556 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.545640 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.545878 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.546173 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.546261 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.546357 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.546537 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.546631 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.546855 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.546947 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.547170 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.547302 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.547506 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.547591 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.547821 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.547906 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.548143 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.548230 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.548458 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.548550 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.548774 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.548859 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.549095 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.549189 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.549416 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.549503 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.549751 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.549848 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.550066 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.550172 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.550403 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.550488 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.550652 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 24 09:08:25.550750 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.551080 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.551399 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.551772 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.552116 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.552541 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.552863 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.553176 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:08:25.553424 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 24 09:08:25.574208 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG oslo_db.sqlalchemy.engines [None req-181f1cd2-db0f-4416-bf37-1e2a827d33d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102359) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 24 09:08:25.575688 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG oslo_db.sqlalchemy.engines [None req-38316a41-3aa9-4135-a2ad-907b02c1fa0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102360) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 24 09:08:25.638579 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.context [None req-181f1cd2-db0f-4416-bf37-1e2a827d33d3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3a4ccec5-1fee-4d4a-81eb-6ec950059a25(cell1) {{(pid=102359) load_cells /opt/stack/nova/nova/context.py:464}} Jan 24 09:08:25.639734 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.context [None req-38316a41-3aa9-4135-a2ad-907b02c1fa0f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3a4ccec5-1fee-4d4a-81eb-6ec950059a25(cell1) {{(pid=102360) load_cells /opt/stack/nova/nova/context.py:464}} Jan 24 09:08:25.642793 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG oslo_concurrency.lockutils [None req-181f1cd2-db0f-4416-bf37-1e2a827d33d3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:08:25.643925 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG oslo_concurrency.lockutils [None req-38316a41-3aa9-4135-a2ad-907b02c1fa0f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:08:25.644381 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG oslo_concurrency.lockutils [None req-181f1cd2-db0f-4416-bf37-1e2a827d33d3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:08:25.645189 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG oslo_concurrency.lockutils [None req-181f1cd2-db0f-4416-bf37-1e2a827d33d3 None None] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:08:25.646376 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG oslo_concurrency.lockutils [None req-38316a41-3aa9-4135-a2ad-907b02c1fa0f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:08:25.647212 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG oslo_concurrency.lockutils [None req-38316a41-3aa9-4135-a2ad-907b02c1fa0f None None] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:08:25.648098 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG oslo_concurrency.lockutils [None req-181f1cd2-db0f-4416-bf37-1e2a827d33d3 None None] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:08:25.649170 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG oslo_concurrency.lockutils [None req-38316a41-3aa9-4135-a2ad-907b02c1fa0f None None] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:08:25.658158 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG oslo_db.sqlalchemy.engines [None req-181f1cd2-db0f-4416-bf37-1e2a827d33d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102359) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 24 09:08:25.661047 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG oslo_db.sqlalchemy.engines [None req-38316a41-3aa9-4135-a2ad-907b02c1fa0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102360) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 24 09:08:25.664071 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG oslo_db.sqlalchemy.engines [None req-38316a41-3aa9-4135-a2ad-907b02c1fa0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102360) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 24 09:08:25.668408 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG oslo_db.sqlalchemy.engines [None req-181f1cd2-db0f-4416-bf37-1e2a827d33d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102359) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 24 09:08:25.825093 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG oslo_db.sqlalchemy.engines [None req-181f1cd2-db0f-4416-bf37-1e2a827d33d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102359) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 24 09:08:25.828149 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG oslo_db.sqlalchemy.engines [None req-38316a41-3aa9-4135-a2ad-907b02c1fa0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102360) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 24 09:08:26.274998 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: WARNING keystonemiddleware.auth_token [None req-181f1cd2-db0f-4416-bf37-1e2a827d33d3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 24 09:08:26.281468 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: WARNING keystonemiddleware.auth_token [None req-181f1cd2-db0f-4416-bf37-1e2a827d33d3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 24 09:08:26.295693 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: WARNING keystonemiddleware.auth_token [None req-38316a41-3aa9-4135-a2ad-907b02c1fa0f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 24 09:08:26.302969 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: WARNING keystonemiddleware.auth_token [None req-38316a41-3aa9-4135-a2ad-907b02c1fa0f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 24 09:08:26.629621 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: WARNING keystonemiddleware.auth_token [None req-181f1cd2-db0f-4416-bf37-1e2a827d33d3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 24 09:08:26.635083 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: WARNING keystonemiddleware.auth_token [None req-181f1cd2-db0f-4416-bf37-1e2a827d33d3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 24 09:08:26.640425 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cab5b5b9c0 pid: 102359 (default app) Jan 24 09:08:26.642578 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi [None req-181f1cd2-db0f-4416-bf37-1e2a827d33d3 None None] Calling method '>' {{(pid=102359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:08:26.643770 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: INFO nova.api.openstack.requestlog [None req-181f1cd2-db0f-4416-bf37-1e2a827d33d3 None None] 10.222.0.113 "GET /compute/v2.1/" status: 200 len: 389 microversion: 2.1 time: 0.001838 Jan 24 09:08:26.644183 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: [pid: 102359|app: 0|req: 1/1] 10.222.0.113 () {50 vars in 793 bytes} [Mon Jan 24 09:08:26 2022] GET /compute/v2.1/ => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:08:26.651220 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: WARNING keystonemiddleware.auth_token [None req-38316a41-3aa9-4135-a2ad-907b02c1fa0f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 24 09:08:26.656412 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: WARNING keystonemiddleware.auth_token [None req-38316a41-3aa9-4135-a2ad-907b02c1fa0f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 24 09:08:26.662486 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cab5b5b9c0 pid: 102360 (default app) Jan 24 09:09:54.946937 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi [None req-181f1cd2-db0f-4416-bf37-1e2a827d33d3 None None] Calling method '>' {{(pid=102359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:09:54.948707 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: INFO nova.api.openstack.requestlog [None req-181f1cd2-db0f-4416-bf37-1e2a827d33d3 None None] 10.222.0.113 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002214 Jan 24 09:09:54.949102 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: [pid: 102359|app: 0|req: 2/2] 10.222.0.113 () {54 vars in 935 bytes} [Mon Jan 24 09:09:54 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:09:55.434204 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi [None req-d79aef97-5626-4f1b-8c62-66c6ca0e65f1 admin admin] Calling method '>' {{(pid=102360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:09:55.467545 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: INFO nova.api.openstack.requestlog [None req-d79aef97-5626-4f1b-8c62-66c6ca0e65f1 admin admin] 10.222.0.113 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.509192 Jan 24 09:09:55.468689 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: [pid: 102360|app: 0|req: 1/3] 10.222.0.113 () {60 vars in 1296 bytes} [Mon Jan 24 09:09:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:09:57.884033 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi [None req-181f1cd2-db0f-4416-bf37-1e2a827d33d3 None None] Calling method '>' {{(pid=102359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:09:57.885819 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: INFO nova.api.openstack.requestlog [None req-181f1cd2-db0f-4416-bf37-1e2a827d33d3 None None] 10.222.0.113 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002490 Jan 24 09:09:57.886734 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: [pid: 102359|app: 0|req: 3/4] 10.222.0.113 () {54 vars in 935 bytes} [Mon Jan 24 09:09:57 2022] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:09:57.964267 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi [None req-797436bf-a11a-450c-9b3d-87bba95a9475 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 256, "name": "cirros256", "rxtx_factor": 1.0, "disk": 1, "os-flavor-access:is_public": true, "id": "c1"}} {{(pid=102360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:09:57.983323 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:09:57.983323 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: warnings.warn(msg) Jan 24 09:09:58.083968 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: INFO nova.api.openstack.requestlog [None req-797436bf-a11a-450c-9b3d-87bba95a9475 admin admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.61 time: 0.187083 Jan 24 09:09:58.085130 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: [pid: 102360|app: 0|req: 2/5] 10.222.0.113 () {64 vars in 1287 bytes} [Mon Jan 24 09:09:57 2022] POST /compute/v2.1/flavors => generated 409 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:09:58.344785 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi [None req-1de78472-a399-4a43-91f0-3df06b36858c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:09:58.347636 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:09:58.347636 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: warnings.warn(msg) Jan 24 09:09:58.507331 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: INFO nova.api.openstack.requestlog [None req-1de78472-a399-4a43-91f0-3df06b36858c admin admin] 10.222.0.113 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.414195 Jan 24 09:09:58.507923 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: [pid: 102359|app: 0|req: 4/6] 10.222.0.113 () {64 vars in 1340 bytes} [Mon Jan 24 09:09:58 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:10:01.244168 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi [None req-797436bf-a11a-450c-9b3d-87bba95a9475 admin admin] Calling method '>' {{(pid=102360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:10:01.247007 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: INFO nova.api.openstack.requestlog [None req-797436bf-a11a-450c-9b3d-87bba95a9475 admin admin] 10.222.0.113 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.003495 Jan 24 09:10:01.247711 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: [pid: 102360|app: 0|req: 3/7] 10.222.0.113 () {54 vars in 935 bytes} [Mon Jan 24 09:10:01 2022] GET /compute/v2.1 => generated 389 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:10:01.425790 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi [None req-568cac9b-771e-4d58-b023-9a542e4fa925 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "disk": 5, "id": "d1", "os-flavor-access:is_public": true, "ram": 512, "vcpus": 1, "rxtx_factor": 1.0, "swap": 0}} {{(pid=102359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:10:01.450379 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:10:01.450379 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: warnings.warn(msg) Jan 24 09:10:01.563687 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: INFO nova.api.openstack.requestlog [None req-568cac9b-771e-4d58-b023-9a542e4fa925 admin admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.300162 Jan 24 09:10:01.565486 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: [pid: 102359|app: 0|req: 5/8] 10.222.0.113 () {64 vars in 1287 bytes} [Mon Jan 24 09:10:01 2022] POST /compute/v2.1/flavors => generated 406 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:10:01.577672 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi [None req-a35d6ec9-1c89-43d6-9b0f-ac106613248f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:10:01.579295 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:10:01.579295 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: warnings.warn(msg) Jan 24 09:10:01.676745 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: INFO nova.api.openstack.requestlog [None req-a35d6ec9-1c89-43d6-9b0f-ac106613248f admin admin] 10.222.0.113 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102058 Jan 24 09:10:01.682372 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: [pid: 102360|app: 0|req: 4/9] 10.222.0.113 () {64 vars in 1340 bytes} [Mon Jan 24 09:10:01 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:10:04.041089 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi [None req-568cac9b-771e-4d58-b023-9a542e4fa925 admin admin] Calling method '>' {{(pid=102359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:10:04.042127 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: INFO nova.api.openstack.requestlog [None req-568cac9b-771e-4d58-b023-9a542e4fa925 admin admin] 10.222.0.113 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001463 Jan 24 09:10:04.042527 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: [pid: 102359|app: 0|req: 6/10] 10.222.0.113 () {54 vars in 935 bytes} [Mon Jan 24 09:10:04 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:10:04.106128 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi [None req-c4472db8-e9ed-4c64-8cb6-928c01329b3c admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds1G", "disk": 10, "id": "d2", "swap": 0, "os-flavor-access:is_public": true, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=102360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:10:04.202047 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: INFO nova.api.openstack.requestlog [None req-c4472db8-e9ed-4c64-8cb6-928c01329b3c admin admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.153381 Jan 24 09:10:04.202893 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: [pid: 102360|app: 0|req: 5/11] 10.222.0.113 () {64 vars in 1287 bytes} [Mon Jan 24 09:10:04 2022] POST /compute/v2.1/flavors => generated 406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 09:10:04.216318 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi [None req-e8b28be4-2956-4f99-94b7-9399473f1b37 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:10:04.315605 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: INFO nova.api.openstack.requestlog [None req-e8b28be4-2956-4f99-94b7-9399473f1b37 admin admin] 10.222.0.113 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103652 Jan 24 09:10:04.316283 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: [pid: 102359|app: 0|req: 7/12] 10.222.0.113 () {64 vars in 1340 bytes} [Mon Jan 24 09:10:04 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:10:06.647437 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi [None req-c4472db8-e9ed-4c64-8cb6-928c01329b3c admin admin] Calling method '>' {{(pid=102360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:10:06.648476 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: INFO nova.api.openstack.requestlog [None req-c4472db8-e9ed-4c64-8cb6-928c01329b3c admin admin] 10.222.0.113 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001471 Jan 24 09:10:06.648896 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: [pid: 102360|app: 0|req: 6/13] 10.222.0.113 () {54 vars in 935 bytes} [Mon Jan 24 09:10:06 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:10:06.728516 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi [None req-f889fad7-1bdb-4c25-ae4d-a4fd5ceaa0d6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "rxtx_factor": 1.0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "name": "ds2G", "os-flavor-access:is_public": true, "id": "d3", "swap": 0}} {{(pid=102359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:10:06.819383 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: INFO nova.api.openstack.requestlog [None req-f889fad7-1bdb-4c25-ae4d-a4fd5ceaa0d6 admin admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.164273 Jan 24 09:10:06.819949 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: [pid: 102359|app: 0|req: 8/14] 10.222.0.113 () {64 vars in 1287 bytes} [Mon Jan 24 09:10:06 2022] POST /compute/v2.1/flavors => generated 406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:10:06.832551 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi [None req-0a2b3d59-7a8e-4cf6-a377-d234e4d8d874 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:10:06.915584 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: INFO nova.api.openstack.requestlog [None req-0a2b3d59-7a8e-4cf6-a377-d234e4d8d874 admin admin] 10.222.0.113 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087280 Jan 24 09:10:06.916186 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: [pid: 102360|app: 0|req: 7/15] 10.222.0.113 () {64 vars in 1340 bytes} [Mon Jan 24 09:10:06 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:10:09.328517 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi [None req-f889fad7-1bdb-4c25-ae4d-a4fd5ceaa0d6 admin admin] Calling method '>' {{(pid=102359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:10:09.329575 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: INFO nova.api.openstack.requestlog [None req-f889fad7-1bdb-4c25-ae4d-a4fd5ceaa0d6 admin admin] 10.222.0.113 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001476 Jan 24 09:10:09.329973 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: [pid: 102359|app: 0|req: 9/16] 10.222.0.113 () {54 vars in 935 bytes} [Mon Jan 24 09:10:09 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:10:09.391045 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi [None req-86dd179c-8fb4-46c7-a240-af6b18249c9d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds4G", "vcpus": 4, "disk": 20}} {{(pid=102360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:10:09.466544 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: INFO nova.api.openstack.requestlog [None req-86dd179c-8fb4-46c7-a240-af6b18249c9d admin admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.130715 Jan 24 09:10:09.467777 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: [pid: 102360|app: 0|req: 8/17] 10.222.0.113 () {64 vars in 1287 bytes} [Mon Jan 24 09:10:09 2022] POST /compute/v2.1/flavors => generated 406 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:10:09.482442 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi [None req-e5e038d7-b421-408e-ba05-193f69705b44 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:10:09.566343 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: INFO nova.api.openstack.requestlog [None req-e5e038d7-b421-408e-ba05-193f69705b44 admin admin] 10.222.0.113 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087460 Jan 24 09:10:09.567030 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: [pid: 102359|app: 0|req: 10/18] 10.222.0.113 () {64 vars in 1340 bytes} [Mon Jan 24 09:10:09 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:10:11.888031 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi [None req-86dd179c-8fb4-46c7-a240-af6b18249c9d admin admin] Calling method '>' {{(pid=102360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:10:11.889049 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: INFO nova.api.openstack.requestlog [None req-86dd179c-8fb4-46c7-a240-af6b18249c9d admin admin] 10.222.0.113 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001432 Jan 24 09:10:11.889450 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: [pid: 102360|app: 0|req: 9/19] 10.222.0.113 () {54 vars in 935 bytes} [Mon Jan 24 09:10:11 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:10:11.961668 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi [None req-da95362a-3fb1-44d3-b7c3-860dd949ef5e admin admin] Calling method '>' {{(pid=102359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:10:11.984688 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: INFO nova.api.openstack.requestlog [None req-da95362a-3fb1-44d3-b7c3-860dd949ef5e admin admin] 10.222.0.113 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2116 microversion: 2.61 time: 0.088469 Jan 24 09:10:12.002974 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: [pid: 102359|app: 0|req: 11/20] 10.222.0.113 () {60 vars in 1296 bytes} [Mon Jan 24 09:10:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2116 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:10:14.273665 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi [None req-86dd179c-8fb4-46c7-a240-af6b18249c9d admin admin] Calling method '>' {{(pid=102360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:10:14.275302 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: INFO nova.api.openstack.requestlog [None req-86dd179c-8fb4-46c7-a240-af6b18249c9d admin admin] 10.222.0.113 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002297 Jan 24 09:10:14.275910 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: [pid: 102360|app: 0|req: 10/21] 10.222.0.113 () {54 vars in 935 bytes} [Mon Jan 24 09:10:14 2022] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:10:14.369900 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi [None req-32f29b3c-b2ad-48a0-b746-bce6cf2d220a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "1", "name": "m1.tiny", "disk": 1, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=102359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:10:14.431225 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: INFO nova.api.openstack.requestlog [None req-32f29b3c-b2ad-48a0-b746-bce6cf2d220a admin admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.146249 Jan 24 09:10:14.431898 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: [pid: 102359|app: 0|req: 12/22] 10.222.0.113 () {64 vars in 1287 bytes} [Mon Jan 24 09:10:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:10:14.449468 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi [None req-d9b81949-2c77-4388-899c-f98a5a113df9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:10:14.549634 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: INFO nova.api.openstack.requestlog [None req-d9b81949-2c77-4388-899c-f98a5a113df9 admin admin] 10.222.0.113 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.105630 Jan 24 09:10:14.550358 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: [pid: 102360|app: 0|req: 11/23] 10.222.0.113 () {64 vars in 1337 bytes} [Mon Jan 24 09:10:14 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:10:16.912447 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi [None req-32f29b3c-b2ad-48a0-b746-bce6cf2d220a admin admin] Calling method '>' {{(pid=102359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:10:16.913925 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: INFO nova.api.openstack.requestlog [None req-32f29b3c-b2ad-48a0-b746-bce6cf2d220a admin admin] 10.222.0.113 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002099 Jan 24 09:10:16.914537 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: [pid: 102359|app: 0|req: 13/24] 10.222.0.113 () {54 vars in 935 bytes} [Mon Jan 24 09:10:16 2022] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:10:16.981966 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi [None req-71e35db2-d089-4f34-8935-36eee9839575 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "swap": 0, "disk": 20, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "os-flavor-access:is_public": true, "ram": 2048, "vcpus": 1}} {{(pid=102360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:10:17.079831 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: INFO nova.api.openstack.requestlog [None req-71e35db2-d089-4f34-8935-36eee9839575 admin admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.156389 Jan 24 09:10:17.080635 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: [pid: 102360|app: 0|req: 12/25] 10.222.0.113 () {64 vars in 1287 bytes} [Mon Jan 24 09:10:16 2022] POST /compute/v2.1/flavors => generated 407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:10:17.097789 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi [None req-9edf3b60-b687-411e-93c8-e89823b0d2e0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:10:17.184758 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: INFO nova.api.openstack.requestlog [None req-9edf3b60-b687-411e-93c8-e89823b0d2e0 admin admin] 10.222.0.113 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092712 Jan 24 09:10:17.185546 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: [pid: 102359|app: 0|req: 14/26] 10.222.0.113 () {64 vars in 1337 bytes} [Mon Jan 24 09:10:17 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:10:19.696174 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi [None req-71e35db2-d089-4f34-8935-36eee9839575 admin admin] Calling method '>' {{(pid=102360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:10:19.697305 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: INFO nova.api.openstack.requestlog [None req-71e35db2-d089-4f34-8935-36eee9839575 admin admin] 10.222.0.113 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001635 Jan 24 09:10:19.697932 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: [pid: 102360|app: 0|req: 13/27] 10.222.0.113 () {54 vars in 935 bytes} [Mon Jan 24 09:10:19 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:10:19.762228 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi [None req-5f3298d0-a1b1-49bb-a213-e07b46108e2d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "id": "3", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 2, "disk": 40}} {{(pid=102359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:10:19.835257 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: INFO nova.api.openstack.requestlog [None req-5f3298d0-a1b1-49bb-a213-e07b46108e2d admin admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.130042 Jan 24 09:10:19.835832 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: [pid: 102359|app: 0|req: 15/28] 10.222.0.113 () {64 vars in 1287 bytes} [Mon Jan 24 09:10:19 2022] POST /compute/v2.1/flavors => generated 408 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:10:19.848548 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi [None req-7a98d917-8104-45fb-a18a-9889375cd2f6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:10:19.937644 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: INFO nova.api.openstack.requestlog [None req-7a98d917-8104-45fb-a18a-9889375cd2f6 admin admin] 10.222.0.113 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093363 Jan 24 09:10:19.938410 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: [pid: 102360|app: 0|req: 14/29] 10.222.0.113 () {64 vars in 1337 bytes} [Mon Jan 24 09:10:19 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:10:22.319249 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi [None req-5f3298d0-a1b1-49bb-a213-e07b46108e2d admin admin] Calling method '>' {{(pid=102359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:10:22.321183 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: INFO nova.api.openstack.requestlog [None req-5f3298d0-a1b1-49bb-a213-e07b46108e2d admin admin] 10.222.0.113 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002340 Jan 24 09:10:22.321997 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: [pid: 102359|app: 0|req: 16/30] 10.222.0.113 () {54 vars in 935 bytes} [Mon Jan 24 09:10:22 2022] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:10:22.393249 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi [None req-3b76e40c-d72e-42ff-a1fd-20a423f250ce admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "name": "m1.large", "rxtx_factor": 1.0, "ram": 8192, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 80, "swap": 0}} {{(pid=102360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:10:22.476324 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: INFO nova.api.openstack.requestlog [None req-3b76e40c-d72e-42ff-a1fd-20a423f250ce admin admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.145321 Jan 24 09:10:22.483215 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: [pid: 102360|app: 0|req: 15/31] 10.222.0.113 () {64 vars in 1287 bytes} [Mon Jan 24 09:10:22 2022] POST /compute/v2.1/flavors => generated 407 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:10:22.491697 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi [None req-f4c12c2a-d781-4e57-9192-2d717959d647 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:10:22.594083 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: INFO nova.api.openstack.requestlog [None req-f4c12c2a-d781-4e57-9192-2d717959d647 admin admin] 10.222.0.113 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.106267 Jan 24 09:10:22.595517 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: [pid: 102359|app: 0|req: 17/32] 10.222.0.113 () {64 vars in 1337 bytes} [Mon Jan 24 09:10:22 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:10:25.072865 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi [None req-3b76e40c-d72e-42ff-a1fd-20a423f250ce admin admin] Calling method '>' {{(pid=102360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:10:25.074308 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: INFO nova.api.openstack.requestlog [None req-3b76e40c-d72e-42ff-a1fd-20a423f250ce admin admin] 10.222.0.113 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001850 Jan 24 09:10:25.076216 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: [pid: 102360|app: 0|req: 16/33] 10.222.0.113 () {54 vars in 935 bytes} [Mon Jan 24 09:10:25 2022] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:10:25.163167 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi [None req-1ec87d73-11f4-4f17-84bb-740337d50ad5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 8, "id": "5", "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "name": "m1.xlarge", "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=102359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:10:25.239639 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: INFO nova.api.openstack.requestlog [None req-1ec87d73-11f4-4f17-84bb-740337d50ad5 admin admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.61 time: 0.156385 Jan 24 09:10:25.243873 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: [pid: 102359|app: 0|req: 18/34] 10.222.0.113 () {64 vars in 1287 bytes} [Mon Jan 24 09:10:25 2022] POST /compute/v2.1/flavors => generated 410 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 09:10:25.258234 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi [None req-d71281ae-2029-4d5f-9a80-5acd0dfcbb80 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:10:25.386477 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: INFO nova.api.openstack.requestlog [None req-d71281ae-2029-4d5f-9a80-5acd0dfcbb80 admin admin] 10.222.0.113 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.133254 Jan 24 09:10:25.398235 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: [pid: 102360|app: 0|req: 17/35] 10.222.0.113 () {64 vars in 1337 bytes} [Mon Jan 24 09:10:25 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:10:49.497527 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi [None req-1ec87d73-11f4-4f17-84bb-740337d50ad5 admin admin] Calling method '>' {{(pid=102359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:10:49.507007 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: INFO nova.api.openstack.requestlog [None req-1ec87d73-11f4-4f17-84bb-740337d50ad5 admin admin] 10.222.0.113 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001493 Jan 24 09:10:49.507007 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: [pid: 102359|app: 0|req: 19/36] 10.222.0.113 () {54 vars in 935 bytes} [Mon Jan 24 09:10:49 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:10:49.557727 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi [None req-9e5b7396-5171-4b50-b962-4ba8d348bf2a admin admin] Calling method '>' {{(pid=102360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:10:49.575325 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: INFO nova.api.openstack.requestlog [None req-9e5b7396-5171-4b50-b962-4ba8d348bf2a admin admin] 10.222.0.113 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4222 microversion: 2.61 time: 0.069444 Jan 24 09:10:49.575898 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: [pid: 102360|app: 0|req: 18/37] 10.222.0.113 () {60 vars in 1296 bytes} [Mon Jan 24 09:10:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4222 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:10:50.986725 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi [None req-1ec87d73-11f4-4f17-84bb-740337d50ad5 admin admin] Calling method '>' {{(pid=102359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:10:50.987733 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: INFO nova.api.openstack.requestlog [None req-1ec87d73-11f4-4f17-84bb-740337d50ad5 admin admin] 10.222.0.113 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001479 Jan 24 09:10:50.988136 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: [pid: 102359|app: 0|req: 20/38] 10.222.0.113 () {56 vars in 1079 bytes} [Mon Jan 24 09:10:50 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 09:10:51.201270 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi [None req-9914395a-5376-4305-8d36-faf656ba24e0 admin admin] Calling method '>' {{(pid=102360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:10:51.207381 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: INFO nova.api.openstack.wsgi [None req-9914395a-5376-4305-8d36-faf656ba24e0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 24 09:10:51.207975 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi [None req-9914395a-5376-4305-8d36-faf656ba24e0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:10:51.208769 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: INFO nova.api.openstack.requestlog [None req-9914395a-5376-4305-8d36-faf656ba24e0 admin admin] 10.222.0.113 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.059314 Jan 24 09:10:51.209290 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: [pid: 102360|app: 0|req: 19/39] 10.222.0.113 () {60 vars in 1195 bytes} [Mon Jan 24 09:10:51 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 24 09:10:51.219359 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi [None req-6d363a2d-a25a-4de2-a094-b7a126541455 admin admin] Calling method '>' {{(pid=102359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:10:51.242226 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: INFO nova.api.openstack.requestlog [None req-6d363a2d-a25a-4de2-a094-b7a126541455 admin admin] 10.222.0.113 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.027220 Jan 24 09:10:51.242791 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: [pid: 102359|app: 0|req: 21/40] 10.222.0.113 () {60 vars in 1215 bytes} [Mon Jan 24 09:10:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:10:51.253062 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi [None req-b7683c57-82e7-41a1-9733-1de6d4b03b14 admin admin] Calling method '>' {{(pid=102360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:10:51.273808 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: INFO nova.api.openstack.requestlog [None req-b7683c57-82e7-41a1-9733-1de6d4b03b14 admin admin] 10.222.0.113 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.024806 Jan 24 09:10:51.274405 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: [pid: 102360|app: 0|req: 20/41] 10.222.0.113 () {60 vars in 1215 bytes} [Mon Jan 24 09:10:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:10:51.284264 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi [None req-34ae93b2-95f1-4ec2-9f50-3cf981dcb1bd admin admin] Calling method '>' {{(pid=102359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:10:51.289769 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: INFO nova.api.openstack.wsgi [None req-34ae93b2-95f1-4ec2-9f50-3cf981dcb1bd admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 24 09:10:51.290380 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi [None req-34ae93b2-95f1-4ec2-9f50-3cf981dcb1bd admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102359) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:10:51.291179 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: INFO nova.api.openstack.requestlog [None req-34ae93b2-95f1-4ec2-9f50-3cf981dcb1bd admin admin] 10.222.0.113 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010930 Jan 24 09:10:51.291686 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: [pid: 102359|app: 0|req: 22/42] 10.222.0.113 () {60 vars in 1195 bytes} [Mon Jan 24 09:10:51 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 24 09:10:52.599782 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi [None req-b7683c57-82e7-41a1-9733-1de6d4b03b14 admin admin] Calling method '>' {{(pid=102360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:10:52.600993 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: INFO nova.api.openstack.requestlog [None req-b7683c57-82e7-41a1-9733-1de6d4b03b14 admin admin] 10.222.0.113 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001566 Jan 24 09:10:52.601402 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: [pid: 102360|app: 0|req: 21/43] 10.222.0.113 () {56 vars in 1079 bytes} [Mon Jan 24 09:10:52 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:10:52.807350 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi [None req-82273af3-bfff-4c4f-84e7-ed2af5130649 admin admin] Calling method '>' {{(pid=102359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:10:52.814270 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: INFO nova.api.openstack.wsgi [None req-82273af3-bfff-4c4f-84e7-ed2af5130649 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 24 09:10:52.814866 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi [None req-82273af3-bfff-4c4f-84e7-ed2af5130649 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102359) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:10:52.815796 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: INFO nova.api.openstack.requestlog [None req-82273af3-bfff-4c4f-84e7-ed2af5130649 admin admin] 10.222.0.113 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.066523 Jan 24 09:10:52.816452 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: [pid: 102359|app: 0|req: 23/44] 10.222.0.113 () {60 vars in 1195 bytes} [Mon Jan 24 09:10:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jan 24 09:10:52.825695 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi [None req-a40c5d6c-8eb7-4817-aac1-5e9fea27269f admin admin] Calling method '>' {{(pid=102360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:10:52.839661 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: INFO nova.api.openstack.requestlog [None req-a40c5d6c-8eb7-4817-aac1-5e9fea27269f admin admin] 10.222.0.113 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.017638 Jan 24 09:10:52.840270 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: [pid: 102360|app: 0|req: 22/45] 10.222.0.113 () {60 vars in 1215 bytes} [Mon Jan 24 09:10:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:10:52.850816 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi [None req-fd0dfe4c-b5bc-49ac-aea3-7eab1f3d2d73 admin admin] Calling method '>' {{(pid=102359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:10:52.865471 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: INFO nova.api.openstack.requestlog [None req-fd0dfe4c-b5bc-49ac-aea3-7eab1f3d2d73 admin admin] 10.222.0.113 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.018194 Jan 24 09:10:52.866050 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: [pid: 102359|app: 0|req: 24/46] 10.222.0.113 () {60 vars in 1215 bytes} [Mon Jan 24 09:10:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 09:10:52.876064 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi [None req-30649a2a-27a8-4b4c-bd9d-ae5caedeeedc admin admin] Calling method '>' {{(pid=102360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:10:52.881743 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: INFO nova.api.openstack.wsgi [None req-30649a2a-27a8-4b4c-bd9d-ae5caedeeedc admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 24 09:10:52.882361 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi [None req-30649a2a-27a8-4b4c-bd9d-ae5caedeeedc admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:10:52.883186 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: INFO nova.api.openstack.requestlog [None req-30649a2a-27a8-4b4c-bd9d-ae5caedeeedc admin admin] 10.222.0.113 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011227 Jan 24 09:10:52.883748 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: [pid: 102360|app: 0|req: 23/47] 10.222.0.113 () {60 vars in 1195 bytes} [Mon Jan 24 09:10:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 24 09:10:54.188400 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi [None req-fd0dfe4c-b5bc-49ac-aea3-7eab1f3d2d73 admin admin] Calling method '>' {{(pid=102359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:10:54.189420 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: INFO nova.api.openstack.requestlog [None req-fd0dfe4c-b5bc-49ac-aea3-7eab1f3d2d73 admin admin] 10.222.0.113 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001787 Jan 24 09:10:54.189826 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: [pid: 102359|app: 0|req: 25/48] 10.222.0.113 () {56 vars in 1079 bytes} [Mon Jan 24 09:10:54 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:10:54.388517 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi [None req-49420db9-4cc0-4528-a5a5-7433e5e5ed4f admin admin] Calling method '>' {{(pid=102360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:10:54.394429 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: INFO nova.api.openstack.wsgi [None req-49420db9-4cc0-4528-a5a5-7433e5e5ed4f admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 24 09:10:54.395503 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi [None req-49420db9-4cc0-4528-a5a5-7433e5e5ed4f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:10:54.396958 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: INFO nova.api.openstack.requestlog [None req-49420db9-4cc0-4528-a5a5-7433e5e5ed4f admin admin] 10.222.0.113 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.062679 Jan 24 09:10:54.397650 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: [pid: 102360|app: 0|req: 24/49] 10.222.0.113 () {60 vars in 1198 bytes} [Mon Jan 24 09:10:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 24 09:10:54.407978 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi [None req-f320ef9e-6527-4d7c-a874-8550aa52583a admin admin] Calling method '>' {{(pid=102359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:10:54.423248 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: INFO nova.api.openstack.requestlog [None req-f320ef9e-6527-4d7c-a874-8550aa52583a admin admin] 10.222.0.113 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.019757 Jan 24 09:10:54.423982 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: [pid: 102359|app: 0|req: 26/50] 10.222.0.113 () {60 vars in 1215 bytes} [Mon Jan 24 09:10:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:10:54.434421 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi [None req-d6fdcafb-d420-4b77-8d6b-937fe647c384 admin admin] Calling method '>' {{(pid=102360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:10:54.448601 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: INFO nova.api.openstack.requestlog [None req-d6fdcafb-d420-4b77-8d6b-937fe647c384 admin admin] 10.222.0.113 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.018214 Jan 24 09:10:54.449167 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: [pid: 102360|app: 0|req: 25/51] 10.222.0.113 () {60 vars in 1215 bytes} [Mon Jan 24 09:10:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 09:10:54.458439 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi [None req-86ac23bd-9458-4dfd-b2e5-121e8295bdac admin admin] Calling method '>' {{(pid=102359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:10:54.463668 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: INFO nova.api.openstack.wsgi [None req-86ac23bd-9458-4dfd-b2e5-121e8295bdac admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 24 09:10:54.464229 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi [None req-86ac23bd-9458-4dfd-b2e5-121e8295bdac admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102359) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:10:54.465014 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: INFO nova.api.openstack.requestlog [None req-86ac23bd-9458-4dfd-b2e5-121e8295bdac admin admin] 10.222.0.113 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010106 Jan 24 09:10:54.465501 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: [pid: 102359|app: 0|req: 27/52] 10.222.0.113 () {60 vars in 1198 bytes} [Mon Jan 24 09:10:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jan 24 09:10:55.767321 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi [None req-d6fdcafb-d420-4b77-8d6b-937fe647c384 admin admin] Calling method '>' {{(pid=102360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:10:55.768320 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: INFO nova.api.openstack.requestlog [None req-d6fdcafb-d420-4b77-8d6b-937fe647c384 admin admin] 10.222.0.113 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001438 Jan 24 09:10:55.768715 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: [pid: 102360|app: 0|req: 26/53] 10.222.0.113 () {56 vars in 1079 bytes} [Mon Jan 24 09:10:55 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:10:55.961436 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi [None req-c4be1c28-ec43-450d-9416-bd67e84b2b67 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:10:56.052728 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: INFO nova.api.openstack.requestlog [None req-c4be1c28-ec43-450d-9416-bd67e84b2b67 admin admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.90 time: 0.142152 Jan 24 09:10:56.053282 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: [pid: 102359|app: 0|req: 28/54] 10.222.0.113 () {64 vars in 1240 bytes} [Mon Jan 24 09:10:55 2022] POST /compute/v2.1/flavors => generated 406 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:10:57.324666 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi [None req-d6fdcafb-d420-4b77-8d6b-937fe647c384 admin admin] Calling method '>' {{(pid=102360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:10:57.325697 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: INFO nova.api.openstack.requestlog [None req-d6fdcafb-d420-4b77-8d6b-937fe647c384 admin admin] 10.222.0.113 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001475 Jan 24 09:10:57.326111 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: [pid: 102360|app: 0|req: 27/55] 10.222.0.113 () {56 vars in 1079 bytes} [Mon Jan 24 09:10:57 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:10:57.526943 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi [None req-cdf7e529-c666-427b-9fab-b3c835dc61c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:10:57.631805 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: INFO nova.api.openstack.requestlog [None req-cdf7e529-c666-427b-9fab-b3c835dc61c9 admin admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.160079 Jan 24 09:10:57.632454 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: [pid: 102359|app: 0|req: 29/56] 10.222.0.113 () {64 vars in 1240 bytes} [Mon Jan 24 09:10:57 2022] POST /compute/v2.1/flavors => generated 407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:10:58.923408 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi [None req-d6fdcafb-d420-4b77-8d6b-937fe647c384 admin admin] Calling method '>' {{(pid=102360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:10:58.924422 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: INFO nova.api.openstack.requestlog [None req-d6fdcafb-d420-4b77-8d6b-937fe647c384 admin admin] 10.222.0.113 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001443 Jan 24 09:10:58.924820 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: [pid: 102360|app: 0|req: 28/57] 10.222.0.113 () {56 vars in 1079 bytes} [Mon Jan 24 09:10:58 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:10:59.130367 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi [None req-02623a95-3523-477e-b1c8-2c4b5c99d6f2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:10:59.196240 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: INFO nova.api.openstack.requestlog [None req-02623a95-3523-477e-b1c8-2c4b5c99d6f2 admin admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.121269 Jan 24 09:10:59.196784 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: [pid: 102359|app: 0|req: 30/58] 10.222.0.113 () {64 vars in 1240 bytes} [Mon Jan 24 09:10:59 2022] POST /compute/v2.1/flavors => generated 409 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 09:11:00.514559 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi [None req-d6fdcafb-d420-4b77-8d6b-937fe647c384 admin admin] Calling method '>' {{(pid=102360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:11:00.515568 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: INFO nova.api.openstack.requestlog [None req-d6fdcafb-d420-4b77-8d6b-937fe647c384 admin admin] 10.222.0.113 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001474 Jan 24 09:11:00.515965 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: [pid: 102360|app: 0|req: 29/59] 10.222.0.113 () {56 vars in 1079 bytes} [Mon Jan 24 09:11:00 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:11:00.710481 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi [None req-30e80633-8a8e-4762-bd3b-b97c6ad89606 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:11:00.810029 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: INFO nova.api.openstack.requestlog [None req-30e80633-8a8e-4762-bd3b-b97c6ad89606 admin admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.90 time: 0.151924 Jan 24 09:11:00.810613 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: [pid: 102359|app: 0|req: 31/60] 10.222.0.113 () {64 vars in 1240 bytes} [Mon Jan 24 09:11:00 2022] POST /compute/v2.1/flavors => generated 411 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:11:02.128455 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi [None req-d6fdcafb-d420-4b77-8d6b-937fe647c384 admin admin] Calling method '>' {{(pid=102360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:11:02.129470 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: INFO nova.api.openstack.requestlog [None req-d6fdcafb-d420-4b77-8d6b-937fe647c384 admin admin] 10.222.0.113 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001440 Jan 24 09:11:02.129868 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: [pid: 102360|app: 0|req: 30/61] 10.222.0.113 () {56 vars in 1079 bytes} [Mon Jan 24 09:11:02 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:11:02.327511 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi [None req-cf75c086-f718-495f-9d08-ff4eee058917 admin admin] Calling method '>' {{(pid=102359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:11:02.346308 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: INFO nova.api.openstack.requestlog [None req-cf75c086-f718-495f-9d08-ff4eee058917 admin admin] 10.222.0.113 "GET /compute/v2.1/flavors/detail" status: 200 len: 5805 microversion: 2.90 time: 0.070026 Jan 24 09:11:02.346780 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: [pid: 102359|app: 0|req: 32/62] 10.222.0.113 () {60 vars in 1207 bytes} [Mon Jan 24 09:11:02 2022] GET /compute/v2.1/flavors/detail => generated 5805 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:11:49.388795 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi [None req-d6fdcafb-d420-4b77-8d6b-937fe647c384 admin admin] Calling method '>' {{(pid=102360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:11:49.389801 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: INFO nova.api.openstack.requestlog [None req-d6fdcafb-d420-4b77-8d6b-937fe647c384 admin admin] 10.222.0.113 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001432 Jan 24 09:11:49.390238 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: [pid: 102360|app: 0|req: 31/63] 10.222.0.113 () {54 vars in 935 bytes} [Mon Jan 24 09:11:49 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:11:49.447535 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi [None req-3068e4ff-e067-42dc-93c4-6ac7982d88b7 admin admin] Calling method '>' {{(pid=102359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:11:49.467769 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: INFO nova.api.openstack.requestlog [None req-3068e4ff-e067-42dc-93c4-6ac7982d88b7 admin admin] 10.222.0.113 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5819 microversion: 2.61 time: 0.071497 Jan 24 09:11:49.468303 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: [pid: 102359|app: 0|req: 33/64] 10.222.0.113 () {60 vars in 1296 bytes} [Mon Jan 24 09:11:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5819 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:11:49.490169 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi [None req-dedc7bd2-941b-41d2-9b13-d99d0be1a2a1 admin admin] Calling method '>' {{(pid=102360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:11:49.497877 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: INFO nova.api.openstack.requestlog [None req-dedc7bd2-941b-41d2-9b13-d99d0be1a2a1 admin admin] 10.222.0.113 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011136 Jan 24 09:11:49.498426 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: [pid: 102360|app: 0|req: 32/65] 10.222.0.113 () {60 vars in 1287 bytes} [Mon Jan 24 09:11:49 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:11:49.509248 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi [None req-29e31ad0-0bb6-4b95-a0f6-d8e44ae94d3e admin admin] Calling method '>' {{(pid=102359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:11:49.516907 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: INFO nova.api.openstack.requestlog [None req-29e31ad0-0bb6-4b95-a0f6-d8e44ae94d3e admin admin] 10.222.0.113 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011073 Jan 24 09:11:49.517415 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: [pid: 102359|app: 0|req: 34/66] 10.222.0.113 () {60 vars in 1290 bytes} [Mon Jan 24 09:11:49 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:11:49.528709 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi [None req-4453790d-b5fc-40e0-b4ba-b43e7ed9a7ee admin admin] Calling method '>' {{(pid=102360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:11:49.536107 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: INFO nova.api.openstack.requestlog [None req-4453790d-b5fc-40e0-b4ba-b43e7ed9a7ee admin admin] 10.222.0.113 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011333 Jan 24 09:11:49.536615 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: [pid: 102360|app: 0|req: 33/67] 10.222.0.113 () {60 vars in 1290 bytes} [Mon Jan 24 09:11:49 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:11:49.548221 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi [None req-8a621332-f61d-44fe-ad2b-f7bcda5c79a9 admin admin] Calling method '>' {{(pid=102359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:11:49.555640 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: INFO nova.api.openstack.requestlog [None req-8a621332-f61d-44fe-ad2b-f7bcda5c79a9 admin admin] 10.222.0.113 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011708 Jan 24 09:11:49.556151 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: [pid: 102359|app: 0|req: 35/68] 10.222.0.113 () {60 vars in 1287 bytes} [Mon Jan 24 09:11:49 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:13:30.351035 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi [None req-503dd577-dc76-489a-bd96-a09516d98f6c tempest-verify_tempest_config-515230365 tempest-verify_tempest_config-515230365-project] Calling method '>' {{(pid=102360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:13:30.353067 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: INFO nova.api.openstack.requestlog [None req-503dd577-dc76-489a-bd96-a09516d98f6c tempest-verify_tempest_config-515230365 tempest-verify_tempest_config-515230365-project] 10.222.0.113 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.134104 Jan 24 09:13:30.353683 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: [pid: 102360|app: 0|req: 34/69] 10.222.0.113 () {58 vars in 1138 bytes} [Mon Jan 24 09:13:30 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 09:15:09.398367 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi [None req-8a621332-f61d-44fe-ad2b-f7bcda5c79a9 admin admin] Calling method '>' {{(pid=102359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:15:09.399394 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: INFO nova.api.openstack.requestlog [None req-8a621332-f61d-44fe-ad2b-f7bcda5c79a9 admin admin] 10.222.0.113 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001464 Jan 24 09:15:09.399780 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: [pid: 102359|app: 0|req: 36/70] 10.222.0.113 () {56 vars in 1079 bytes} [Mon Jan 24 09:15:09 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:15:09.663065 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi [None req-ed300a1c-f7ef-4259-ad05-34412f30bae1 admin admin] Calling method '>' {{(pid=102360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:15:09.664256 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:15:09.664256 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: warnings.warn(msg) Jan 24 09:15:09.665798 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG oslo_concurrency.lockutils [None req-ed300a1c-f7ef-4259-ad05-34412f30bae1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:15:09.666274 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG oslo_concurrency.lockutils [None req-ed300a1c-f7ef-4259-ad05-34412f30bae1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:15:09.667121 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG oslo_concurrency.lockutils [None req-ed300a1c-f7ef-4259-ad05-34412f30bae1 admin admin] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:15:09.667545 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG oslo_concurrency.lockutils [None req-ed300a1c-f7ef-4259-ad05-34412f30bae1 admin admin] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:15:09.703029 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: INFO nova.api.openstack.requestlog [None req-ed300a1c-f7ef-4259-ad05-34412f30bae1 admin admin] 10.222.0.113 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.158691 Jan 24 09:15:09.703593 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: [pid: 102360|app: 0|req: 35/71] 10.222.0.113 () {60 vars in 1198 bytes} [Mon Jan 24 09:15:09 2022] GET /compute/v2.1/os-services => generated 794 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:15:11.018025 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi [None req-8a621332-f61d-44fe-ad2b-f7bcda5c79a9 admin admin] Calling method '>' {{(pid=102359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:15:11.019071 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: INFO nova.api.openstack.requestlog [None req-8a621332-f61d-44fe-ad2b-f7bcda5c79a9 admin admin] 10.222.0.113 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001465 Jan 24 09:15:11.019463 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: [pid: 102359|app: 0|req: 37/72] 10.222.0.113 () {56 vars in 1079 bytes} [Mon Jan 24 09:15:11 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:15:11.219194 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi [None req-03f81077-50a8-4835-a4c4-4db3580f86cb admin admin] Calling method '>' {{(pid=102360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:15:11.220376 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:15:11.220376 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: warnings.warn(msg) Jan 24 09:15:11.221917 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG oslo_concurrency.lockutils [None req-03f81077-50a8-4835-a4c4-4db3580f86cb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:15:11.222636 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG oslo_concurrency.lockutils [None req-03f81077-50a8-4835-a4c4-4db3580f86cb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:15:11.223179 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG oslo_concurrency.lockutils [None req-03f81077-50a8-4835-a4c4-4db3580f86cb admin admin] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:15:11.223606 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG oslo_concurrency.lockutils [None req-03f81077-50a8-4835-a4c4-4db3580f86cb admin admin] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:15:11.242849 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: INFO nova.api.openstack.requestlog [None req-03f81077-50a8-4835-a4c4-4db3580f86cb admin admin] 10.222.0.113 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.075926 Jan 24 09:15:11.243347 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: [pid: 102360|app: 0|req: 36/73] 10.222.0.113 () {60 vars in 1198 bytes} [Mon Jan 24 09:15:11 2022] GET /compute/v2.1/os-services => generated 794 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:15:23.049238 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi [None req-8a621332-f61d-44fe-ad2b-f7bcda5c79a9 admin admin] Calling method '>' {{(pid=102359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:15:23.050256 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: INFO nova.api.openstack.requestlog [None req-8a621332-f61d-44fe-ad2b-f7bcda5c79a9 admin admin] 10.222.0.113 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001410 Jan 24 09:15:23.050649 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: [pid: 102359|app: 0|req: 38/74] 10.222.0.113 () {56 vars in 1079 bytes} [Mon Jan 24 09:15:23 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:15:23.245081 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi [None req-c1e695ef-29cb-47e6-80d7-1c1f0505ecef admin admin] Calling method '>' {{(pid=102360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:15:23.246284 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:15:23.246284 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: warnings.warn(msg) Jan 24 09:15:23.247796 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG oslo_concurrency.lockutils [None req-c1e695ef-29cb-47e6-80d7-1c1f0505ecef admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:15:23.248243 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG oslo_concurrency.lockutils [None req-c1e695ef-29cb-47e6-80d7-1c1f0505ecef admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:15:23.249073 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG oslo_concurrency.lockutils [None req-c1e695ef-29cb-47e6-80d7-1c1f0505ecef admin admin] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:15:23.249657 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG oslo_concurrency.lockutils [None req-c1e695ef-29cb-47e6-80d7-1c1f0505ecef admin admin] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:15:23.273586 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: INFO nova.api.openstack.requestlog [None req-c1e695ef-29cb-47e6-80d7-1c1f0505ecef admin admin] 10.222.0.113 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.079494 Jan 24 09:15:23.274076 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: [pid: 102360|app: 0|req: 37/75] 10.222.0.113 () {60 vars in 1198 bytes} [Mon Jan 24 09:15:23 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:15:24.576636 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: DEBUG nova.api.openstack.wsgi [None req-8a621332-f61d-44fe-ad2b-f7bcda5c79a9 admin admin] Calling method '>' {{(pid=102359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:15:24.578413 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: INFO nova.api.openstack.requestlog [None req-8a621332-f61d-44fe-ad2b-f7bcda5c79a9 admin admin] 10.222.0.113 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002148 Jan 24 09:15:24.578810 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: [pid: 102359|app: 0|req: 39/76] 10.222.0.113 () {56 vars in 1079 bytes} [Mon Jan 24 09:15:24 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:15:24.783769 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG nova.api.openstack.wsgi [None req-4a1ca26e-90e0-4112-ab24-bf9fcadc7724 admin admin] Calling method '>' {{(pid=102360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:15:24.784962 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:15:24.784962 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: warnings.warn(msg) Jan 24 09:15:24.786518 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG oslo_concurrency.lockutils [None req-4a1ca26e-90e0-4112-ab24-bf9fcadc7724 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:15:24.786961 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG oslo_concurrency.lockutils [None req-4a1ca26e-90e0-4112-ab24-bf9fcadc7724 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:15:24.787757 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG oslo_concurrency.lockutils [None req-4a1ca26e-90e0-4112-ab24-bf9fcadc7724 admin admin] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:15:24.788175 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: DEBUG oslo_concurrency.lockutils [None req-4a1ca26e-90e0-4112-ab24-bf9fcadc7724 admin admin] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:15:24.809124 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: INFO nova.api.openstack.requestlog [None req-4a1ca26e-90e0-4112-ab24-bf9fcadc7724 admin admin] 10.222.0.113 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.086868 Jan 24 09:15:24.809681 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: [pid: 102360|app: 0|req: 38/77] 10.222.0.113 () {60 vars in 1198 bytes} [Mon Jan 24 09:15:24 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:16:25.892674 dv-cinder-804035-26-iscsi devstack@n-api.service[102358]: Mon Jan 24 09:16:25 2022 - graceful shutdown triggered... Jan 24 09:16:25.892815 dv-cinder-804035-26-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jan 24 09:16:25.893768 dv-cinder-804035-26-iscsi devstack@n-api.service[102359]: Gracefully killing worker 1 (pid: 102359)... Jan 24 09:16:25.894251 dv-cinder-804035-26-iscsi devstack@n-api.service[102360]: Gracefully killing worker 2 (pid: 102360)... Jan 24 09:16:26.894220 dv-cinder-804035-26-iscsi devstack@n-api.service[102358]: worker 1 buried after 1 seconds Jan 24 09:16:26.894220 dv-cinder-804035-26-iscsi devstack@n-api.service[102358]: worker 2 buried after 1 seconds Jan 24 09:16:26.894220 dv-cinder-804035-26-iscsi devstack@n-api.service[102358]: goodbye to uWSGI. Jan 24 09:16:26.895883 dv-cinder-804035-26-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jan 24 09:16:26.896549 dv-cinder-804035-26-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jan 24 09:16:26.900753 dv-cinder-804035-26-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 24 09:16:26.917315 dv-cinder-804035-26-iscsi devstack@n-api.service[116850]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 24 09:16:26.919323 dv-cinder-804035-26-iscsi devstack@n-api.service[116850]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jan 24 09:16:26 2022] *** Jan 24 09:16:26.919323 dv-cinder-804035-26-iscsi devstack@n-api.service[116850]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 24 09:16:26.919323 dv-cinder-804035-26-iscsi devstack@n-api.service[116850]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 24 09:16:26.919323 dv-cinder-804035-26-iscsi devstack@n-api.service[116850]: nodename: dv-cinder-804035-26-iscsi Jan 24 09:16:26.919323 dv-cinder-804035-26-iscsi devstack@n-api.service[116850]: machine: x86_64 Jan 24 09:16:26.919323 dv-cinder-804035-26-iscsi devstack@n-api.service[116850]: clock source: unix Jan 24 09:16:26.919323 dv-cinder-804035-26-iscsi devstack@n-api.service[116850]: pcre jit disabled Jan 24 09:16:26.919323 dv-cinder-804035-26-iscsi devstack@n-api.service[116850]: detected number of CPU cores: 4 Jan 24 09:16:26.919323 dv-cinder-804035-26-iscsi devstack@n-api.service[116850]: current working directory: / Jan 24 09:16:26.919323 dv-cinder-804035-26-iscsi devstack@n-api.service[116850]: detected binary path: /usr/bin/uwsgi-core Jan 24 09:16:26.920133 dv-cinder-804035-26-iscsi devstack@n-api.service[116850]: your processes number limit is 47680 Jan 24 09:16:26.920133 dv-cinder-804035-26-iscsi devstack@n-api.service[116850]: your memory page size is 4096 bytes Jan 24 09:16:26.920133 dv-cinder-804035-26-iscsi devstack@n-api.service[116850]: detected max file descriptor number: 2048 Jan 24 09:16:26.920133 dv-cinder-804035-26-iscsi devstack@n-api.service[116850]: lock engine: pthread robust mutexes Jan 24 09:16:26.920133 dv-cinder-804035-26-iscsi devstack@n-api.service[116850]: thunder lock: enabled Jan 24 09:16:26.920133 dv-cinder-804035-26-iscsi devstack@n-api.service[116850]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 24 09:16:26.920133 dv-cinder-804035-26-iscsi devstack@n-api.service[116850]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 24 09:16:26.967777 dv-cinder-804035-26-iscsi devstack@n-api.service[116850]: Python main interpreter initialized at 0x561c41e0a9c0 Jan 24 09:16:26.967777 dv-cinder-804035-26-iscsi devstack@n-api.service[116850]: python threads support enabled Jan 24 09:16:26.967777 dv-cinder-804035-26-iscsi devstack@n-api.service[116850]: your server socket listen backlog is limited to 100 connections Jan 24 09:16:26.967777 dv-cinder-804035-26-iscsi devstack@n-api.service[116850]: your mercy for graceful operations on workers is 90 seconds Jan 24 09:16:26.968252 dv-cinder-804035-26-iscsi devstack@n-api.service[116850]: mapped 403077 bytes (393 KB) for 2 cores Jan 24 09:16:26.968252 dv-cinder-804035-26-iscsi devstack@n-api.service[116850]: *** Operational MODE: preforking *** Jan 24 09:16:26.968542 dv-cinder-804035-26-iscsi devstack@n-api.service[116850]: *** uWSGI is running in multiple interpreter mode *** Jan 24 09:16:26.968542 dv-cinder-804035-26-iscsi devstack@n-api.service[116850]: spawned uWSGI master process (pid: 116850) Jan 24 09:16:26.968542 dv-cinder-804035-26-iscsi devstack@n-api.service[116850]: spawned uWSGI worker 1 (pid: 116863, cores: 1) Jan 24 09:16:26.968542 dv-cinder-804035-26-iscsi devstack@n-api.service[116850]: spawned uWSGI worker 2 (pid: 116864, cores: 1) Jan 24 09:16:26.968542 dv-cinder-804035-26-iscsi devstack@n-api.service[116850]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 24 09:16:26.968779 dv-cinder-804035-26-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 24 09:16:29.032977 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 24 09:16:29.032977 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: from cryptography.utils import int_from_bytes Jan 24 09:16:29.034185 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 24 09:16:29.034185 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: from cryptography.utils import int_from_bytes Jan 24 09:16:29.058176 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 24 09:16:29.058176 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: from cryptography.utils import int_from_bytes Jan 24 09:16:29.059046 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 24 09:16:29.059046 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: from cryptography.utils import int_from_bytes Jan 24 09:16:34.490506 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 24 09:16:34.491649 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 24 09:16:34.491967 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 24 09:16:34.492418 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 24 09:16:34.492745 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 24 09:16:34.493214 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.493685 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.493954 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.494413 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.494827 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.495218 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.495624 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.496024 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.496442 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.496777 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.497174 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.497593 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804035-26-iscsi {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.497998 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.498421 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.498816 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.499217 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.501075 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.501075 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.501075 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.501075 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.501841 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.502207 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.502541 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.502900 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.503520 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.504106 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.504686 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.505245 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.505851 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.506442 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.508044 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804035-26-iscsi {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.508553 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.508936 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.509315 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.509775 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.510157 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.510489 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.510829 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.511218 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.511546 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.511892 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.512228 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.512566 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.512902 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.513221 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.513546 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.513963 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.514332 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.514696 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.515021 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.515286 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.515609 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.515949 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.516345 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.516700 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.516980 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.517243 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.517578 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.517916 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.518707 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.518825 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.519090 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.519413 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.519734 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.520053 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.520371 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.520692 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.521023 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.521483 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.521687 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.522008 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.522393 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.522816 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.113 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.523075 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.113 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.523394 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.523747 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.524076 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.524396 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.524806 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.525056 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.525378 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.525695 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.526013 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.526380 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.526737 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.527054 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.527315 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.527630 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.527950 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.528437 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.528766 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.529084 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.529401 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.529717 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.530034 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.530459 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.530747 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.531066 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.531514 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.531839 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.532157 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.532473 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.532823 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.533121 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.533454 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.533770 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.534348 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.534669 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.534987 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.535320 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.536229 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.536577 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.536916 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.537240 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.537563 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.538124 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.538296 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.538604 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.538901 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.539219 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.539537 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.539871 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.540187 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.540507 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.540827 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.541146 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.541465 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.541784 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.542152 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.542441 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.542755 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.543085 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.543417 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.543739 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.544168 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.544493 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.544824 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.545178 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.545521 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.545876 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.546238 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.546572 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.546915 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.547247 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.547572 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.547897 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.548235 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.548557 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.548743 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 24 09:16:34.549406 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.549571 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 24 09:16:34.549719 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.549719 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.550163 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 24 09:16:34.550340 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.550495 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 24 09:16:34.550650 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.550796 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 24 09:16:34.550949 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.551094 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.551254 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.551411 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.551562 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.551718 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.551874 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.552132 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.552288 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.552288 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.552570 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.552723 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.552875 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.553036 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.554332 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.554492 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.554646 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.554646 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.554922 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.554922 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.555231 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.555384 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.555538 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.555683 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.555947 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804035-26-iscsi {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.556103 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.556103 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.556103 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.556523 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.556675 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.556830 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.556984 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.557138 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.557301 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.557454 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.557599 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.557599 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.557887 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.558050 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.558269 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.558586 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.558747 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.558747 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.558747 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.559652 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.559846 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.560001 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.560162 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.560335 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.560584 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.560743 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.560897 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.561042 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.561197 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.561344 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.561488 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.561633 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.561792 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.561951 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.562138 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.562305 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.562453 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.562597 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.562741 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.562899 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.563052 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.563052 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.563326 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804035-26-iscsi {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.563481 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.563645 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.563792 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.563936 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.564079 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.564222 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.564376 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.564536 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.564690 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.564835 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.564986 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.565138 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.565289 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.565443 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.565607 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.565759 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.565923 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.566164 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.566331 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.566477 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.566622 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.566766 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.566909 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.567060 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.567220 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.567374 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.567527 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.567684 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.567836 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.567992 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.568145 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.568298 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.568451 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.568784 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.568945 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.569106 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.569997 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.570173 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.570324 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.570491 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.570760 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.570760 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.571069 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.571223 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.571375 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.571528 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.571699 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.572084 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.572260 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.572413 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.572566 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.572733 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.572959 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.573117 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.573271 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.573426 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.573579 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.573727 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.573886 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.574033 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.574227 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.574375 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.574527 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.574689 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.574849 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.575004 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.575150 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.575301 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.575446 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.575604 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.575750 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.575894 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.576040 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.576285 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.576437 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.576593 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.576756 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.576901 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.577046 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.577198 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.577350 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.577508 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.577662 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.577815 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.577980 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.113 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.578240 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.578394 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.113 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.578547 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.578725 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.579111 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.579267 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.579413 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.579566 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.579719 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.579873 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.580210 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.580372 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.580524 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.580669 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.580821 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.580975 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.581229 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.581229 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.581525 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.581670 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.581830 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.581987 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.582155 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.582307 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.582461 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.582607 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.582760 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.582905 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.583056 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.583202 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.583366 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.583512 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.583665 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.583884 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.584031 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.584184 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.584336 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.584483 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.584636 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.584809 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.584966 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.584966 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.585269 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.585423 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.585587 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.585746 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.585892 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.585892 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.586259 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.586500 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.586658 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.586813 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.586966 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.587121 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.587276 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.587443 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.587598 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.587751 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.587910 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.588068 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.588227 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.588438 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.588593 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.588747 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.589045 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.589201 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.589436 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.589586 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.589750 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.589897 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.590041 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.590387 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.590553 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.590701 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.590845 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.590999 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.591144 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.591399 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.591399 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.591399 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.591399 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.591982 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.592137 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.592290 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.592442 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.592595 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.592751 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.592896 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.593048 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.593193 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.593338 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.593490 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.593645 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.593799 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.593962 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.594166 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.594329 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.594481 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.594641 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.594862 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.595011 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.595163 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.595309 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.595452 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.595675 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.595830 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.595997 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.596143 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.596298 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.596472 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.596688 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.596844 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.596990 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.597134 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.597278 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.597437 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.597584 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.597729 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.597891 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.598049 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.598218 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.598381 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.598527 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.598671 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.598822 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.598967 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.599266 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.599430 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.599576 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.599729 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.599874 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.600027 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 09:16:34.600287 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.600713 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.600872 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.601019 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.601182 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.601336 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.601601 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.601763 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.601924 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.601924 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.602249 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.602407 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.602407 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.602713 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.602866 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.603026 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.603171 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.603326 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.603480 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.603626 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.603769 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.603913 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.604066 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.604225 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.604379 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.604535 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.604679 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.604831 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.604977 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.605136 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.605282 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.605435 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.605588 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.605744 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.605890 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.606047 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.606237 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.606384 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.606549 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.606713 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.606713 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.607081 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.607235 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.607382 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.607526 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.607677 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.607840 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.607994 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.608146 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.608299 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.608445 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.608599 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.608753 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.608899 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.609050 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.609339 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.609501 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.609657 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.609657 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.609944 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.610088 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.610270 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.610424 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.610610 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.610927 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.611092 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.611238 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.611383 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.611537 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.611798 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.611975 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.612608 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.612778 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.612778 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.613067 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.613223 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.613388 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.613543 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.613688 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.613834 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.614018 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.614275 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.614439 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.614592 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.614747 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.614894 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.615047 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.615194 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.615344 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.615503 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.615657 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.615810 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.615969 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.616676 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.616830 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.617065 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.617231 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.617379 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.617532 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.617677 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.617840 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.617988 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.618176 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.618337 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.618337 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.618622 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.618775 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.618930 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.619086 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.619232 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.619520 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.619520 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.619520 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.619949 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.620108 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.620254 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.620410 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.620569 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.620717 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.620893 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.621125 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.621125 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.621428 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.621607 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.621938 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.622128 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.622299 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.622584 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.622737 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.622883 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.623047 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.623195 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.623347 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.623493 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.623645 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.623799 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.623953 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.624106 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.624253 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.624398 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.624564 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.624712 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.624871 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.625017 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.625162 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.625356 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.625509 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.625654 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.625876 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.626026 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.626248 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.626397 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.626561 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.626722 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.626869 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.627013 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.627254 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.627409 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.627561 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.627729 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.627901 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.628048 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.628202 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.628348 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.628494 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.628660 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.628813 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.628967 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.629112 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.629258 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.629402 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.629710 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.629861 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.630015 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.630183 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.630341 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.630498 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.630652 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.630652 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.630938 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.631108 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.631335 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.631499 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.631697 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.632545 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.632710 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.632862 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.633027 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.633194 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.633353 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.633513 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.633685 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.633838 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.633999 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.634183 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.634183 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.634486 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.634645 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.634645 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.634946 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.635100 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.635260 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.635412 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.635562 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.635725 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.635890 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.636050 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.636208 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.636360 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.636519 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.636679 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.636845 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.636998 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.637159 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.637395 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.637561 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.637731 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.637907 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.638060 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.638248 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.638412 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.638565 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.638565 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.638869 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.639019 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.639171 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.639322 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.639472 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.639781 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.639964 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.640126 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.640287 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.640440 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.640591 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.640591 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.640902 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.641055 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.641206 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.641445 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.641612 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.641779 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.641939 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.642142 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.642302 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.642486 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.642832 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.643003 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.643157 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.643308 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.643468 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.643621 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.643621 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.643931 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.644084 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.644244 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.644415 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.644567 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.644733 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.644892 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.645044 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.645196 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.645348 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.645506 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.645671 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.645824 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.645975 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.646162 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.646329 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.646491 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.646656 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.646816 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.646969 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.647119 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.647119 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.647537 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.647537 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.647852 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.648170 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.648337 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.648490 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.648663 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.648825 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.648985 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.649137 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.649295 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.649449 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.649610 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.649911 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.650081 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.650272 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.650272 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.650570 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.650732 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.650913 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.651067 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.651231 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.651393 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.651652 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.651810 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.651962 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.652140 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.652293 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.652457 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.652625 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.652625 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.653135 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.653300 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.653452 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.653612 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.653774 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.653940 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.654139 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.654139 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.654447 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.654599 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.654763 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.654915 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.655076 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.655235 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.655408 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.655570 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.655724 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.655874 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.656032 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.656183 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.656340 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.656507 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.656664 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.656823 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.656984 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.657142 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.657300 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.657569 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.657800 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.657961 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.658134 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.658294 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.658461 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.658623 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.658784 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.658938 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.659096 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.659256 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.659417 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.659587 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.659747 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.660051 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.660224 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.660377 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.660377 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.660688 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.660847 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.661000 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.661152 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.661303 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.661468 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.661468 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.661878 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.662044 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.662274 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.662427 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.662595 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.662756 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.663248 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.663464 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.663628 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.663797 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.663963 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.664118 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.664270 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.664441 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.664595 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.664760 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.664954 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.665258 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.665422 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.665584 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.665745 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.665909 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.665909 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.666255 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.666411 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.666411 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.666711 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.666876 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.667036 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.667203 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.667356 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.667517 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.667679 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.667938 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.668117 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.668283 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.668437 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.668596 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.668781 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.668947 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.669099 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.669251 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.669403 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.669560 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.669725 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.669884 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.670239 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.670407 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.670568 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.670729 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.670895 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.671067 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.671227 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.671469 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.671633 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.671883 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.672139 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.672300 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.672454 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.672606 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.672606 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.672916 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.673070 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.673457 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.673640 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.673802 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.673962 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.674202 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.674376 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.674531 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.674681 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.674832 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.674995 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.675156 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.675308 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.675308 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.675618 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.675780 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.675932 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.676083 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.676241 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.676393 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.676554 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.676717 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.676869 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.677030 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.677181 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.677333 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.677498 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.677671 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.677825 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.678081 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.678261 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.678425 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.678586 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.678750 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.679628 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.679799 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.679961 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.680151 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.680471 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.680630 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.680799 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.680954 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.681104 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.681269 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.681430 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.681595 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.681757 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.681918 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.682070 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.682361 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.682529 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.682691 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.682854 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.683008 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.683008 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.683321 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.683615 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.683615 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.684272 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.684427 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.684427 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.684732 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.684885 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.685037 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.685196 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.685360 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.685527 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.685680 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.685831 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.685991 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.686168 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.686168 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.686483 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.686636 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.686787 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.686938 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.687096 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.687262 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.687262 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.687262 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.687706 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.687865 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.688016 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.688288 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.688451 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.688619 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.688776 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.688935 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.689086 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.689323 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.689478 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.689653 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.689813 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.689976 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.690161 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.690349 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.690680 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.690844 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.691010 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.691164 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.691326 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.691494 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.691647 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.691810 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.691962 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.692121 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.692290 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.692290 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.692709 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.692870 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.693024 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.693182 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.693182 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.693182 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.693642 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.693924 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.693924 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.695000 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.695173 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.695328 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.695488 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.695650 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.695650 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.695956 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.696109 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.696260 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.696423 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.696576 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.696728 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.696900 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.697054 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.697214 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.697366 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.697517 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.697670 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.697670 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.697968 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.698184 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.698432 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.698610 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.698610 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.698931 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.699085 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.699236 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.699395 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.699556 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.699751 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.699916 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.700077 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.700242 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.700409 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.700735 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.700898 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.701113 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.701277 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.701437 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.701604 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.701757 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.701917 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.702077 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.702271 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.702425 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.702683 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.702852 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.703015 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.703169 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.703341 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.703341 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.703649 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.703808 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.704078 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.704238 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.704503 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.704672 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.704835 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.704996 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.705149 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.705149 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.705467 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.705630 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.705790 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.705943 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.706206 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.706381 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.706541 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.706703 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.706864 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.706864 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.707162 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.707322 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.707484 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.707484 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.707790 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.707950 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.708112 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.708264 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.708444 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.708688 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.708848 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.709000 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.709153 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.709304 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.709464 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.709627 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.710394 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.710812 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.710988 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.711142 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.711142 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.711453 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.711606 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.711757 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.711915 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.712083 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.712244 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.712479 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.712652 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.712896 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.713062 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.713234 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.713403 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.713569 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.713728 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.713888 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.714041 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.714338 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.714522 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.714779 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.714938 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.715111 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.715111 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.715427 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.715589 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.715749 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.715902 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.716054 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.716221 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.716221 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.716519 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.716673 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.716824 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.716984 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.717158 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.717321 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.717481 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.717636 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.717789 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.717789 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.718124 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.718124 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.718451 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.718728 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.719091 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.719361 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.719624 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.719890 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.720130 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.720383 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.720383 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.720383 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.721416 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.721662 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.721906 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.722213 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.722477 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.722817 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.723234 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.723501 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.723760 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.724007 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.724263 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.724263 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.724737 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.725210 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.725531 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.726316 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.726562 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.726831 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.727093 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.727337 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.727597 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.727846 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.728106 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.728106 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.728559 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.728782 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.729025 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.729412 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.729634 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.729801 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.729963 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.730149 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.730310 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.730487 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.730653 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.730807 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.730959 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.731345 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.731345 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.731645 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.731645 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.731960 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.732113 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.732268 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.732427 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.732598 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.732774 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.732928 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.732928 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.733367 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.733530 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.733694 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.733848 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.734001 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.734186 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.734354 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.734516 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.734678 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.734844 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.735186 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.735484 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.735651 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.735805 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.735972 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.736128 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.736281 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.736434 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.736603 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.736767 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.736920 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.737081 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.737249 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.739059 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.739234 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.739516 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.739516 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.739827 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.739827 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.739827 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.740395 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.740395 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.740700 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.740860 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.741818 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.742090 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.742334 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.742505 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.742673 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.742829 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.742982 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.743144 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.743328 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.743585 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.743746 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.743746 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.743746 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.743746 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.743746 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.743746 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.743746 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.744771 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.744927 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.745094 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.747596 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.747919 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.748086 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.748086 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.748390 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.748560 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.748734 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.748895 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.749060 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.749060 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.749060 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.749539 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.749791 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.749960 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.750176 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.750339 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.750339 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.750339 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.750339 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.750339 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.750339 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.751265 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.751427 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.751590 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.751771 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.752099 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.752277 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.752452 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.752617 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.752771 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.752924 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.753089 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.753251 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.753414 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.753600 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.753852 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.754011 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.754199 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.754365 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.754534 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.754688 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.754849 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.755004 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.755004 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.755307 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.755474 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.755634 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.755794 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.755954 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.756115 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.756276 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.756440 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.756618 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.757328 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.757491 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.757644 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.757808 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.758091 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.758288 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.758452 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.758617 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.758771 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.759007 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.759163 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.759316 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.759479 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.759641 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.759822 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.759822 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.760234 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.760234 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.760536 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.760691 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.760844 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.761006 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.761160 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.761313 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.761479 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.761641 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.761803 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.761957 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.761957 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.762538 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.762746 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.762968 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.763139 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.763293 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.763455 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.763617 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.763772 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.764044 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.764216 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.764380 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.764542 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.764708 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.764862 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.765014 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.765177 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.765330 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.765484 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.765645 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.765808 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.765979 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.766155 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.766326 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.766488 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.766488 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.766793 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.766793 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.767165 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.767328 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.767328 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.767620 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.767773 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.767936 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.768107 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.768107 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.768521 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.768521 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.768834 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.768834 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.769143 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.769300 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.769454 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.769607 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.769607 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.769916 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.770111 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.770341 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.770500 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.770500 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.770802 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.770973 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.771129 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.771288 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.771288 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.771580 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.771759 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.771971 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.772130 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.772130 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.772750 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.772930 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.772930 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.773253 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.773406 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.773559 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.773712 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.773897 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.774080 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.774339 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.774515 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.774515 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.774863 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.775025 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.775190 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.775356 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.775509 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.775711 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.775891 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.775891 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 24 09:16:34.776192 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.776192 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.776192 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.776192 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.776192 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.776192 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.776192 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.776192 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.777435 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.777435 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.777435 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.777435 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.777435 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.777435 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.777435 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.777435 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.779238 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.779238 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.779238 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.779238 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.779238 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.779238 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.779238 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.779238 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.780519 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.780519 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.780519 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.780519 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.781227 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.781227 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.781527 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.781861 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.782217 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.782785 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.783588 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.783898 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.784407 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.784681 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.785709 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.785709 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.785709 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.786462 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.786462 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.786778 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.787058 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.787632 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.788564 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.789081 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.789623 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.791103 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.791103 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.791625 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.792070 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.793503 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.794384 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.794750 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.795178 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.797114 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.797114 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.797114 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.797114 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.797114 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.797114 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.799643 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.799812 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_db.sqlalchemy.engines [None req-faf265dc-1f0b-456a-bb01-7d6edab9831d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116863) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 24 09:16:34.799977 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.799977 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.800281 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.800737 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.801043 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.801506 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.801855 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.802214 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.802847 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.803087 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.803443 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.804169 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.805332 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.805944 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.806565 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.807691 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.808276 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.808900 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.809724 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.810432 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.811604 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.811604 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.812219 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.821487 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.822180 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.822804 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.823612 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.824226 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.824838 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.825443 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.826051 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.826688 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.827294 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.827989 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.828577 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.829225 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.829816 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.830398 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.830956 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.831570 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.832158 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.832763 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.833355 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.833945 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.834666 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.835932 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.836553 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.837142 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.837667 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.837667 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.838416 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.838766 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.839104 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.839452 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.839801 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.840135 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.840476 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.840808 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.841155 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.841521 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.841869 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.842237 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.842614 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.842942 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.843267 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.843594 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.843941 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.844295 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.844806 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.845154 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.845483 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.845824 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.846820 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.847188 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.847540 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.847888 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.848224 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.848579 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.848913 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.849246 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.849578 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.849910 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.850265 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.850963 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.851695 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.852083 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.852519 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.852903 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.853334 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.853819 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.854269 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.854606 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.854961 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.855294 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.855632 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.855962 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.856291 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.856627 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.856963 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.857307 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.857650 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.857995 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.858360 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.858725 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.859057 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.859421 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.859893 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.860230 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.860741 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.861285 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 09:16:34.861742 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 24 09:16:34.889724 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_db.sqlalchemy.engines [None req-6905310e-3ea8-425a-b5b5-87e8c4ffebb8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116864) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 24 09:16:34.891099 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.context [None req-faf265dc-1f0b-456a-bb01-7d6edab9831d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3a4ccec5-1fee-4d4a-81eb-6ec950059a25(cell1) {{(pid=116863) load_cells /opt/stack/nova/nova/context.py:464}} Jan 24 09:16:34.895623 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-faf265dc-1f0b-456a-bb01-7d6edab9831d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:16:34.897411 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-faf265dc-1f0b-456a-bb01-7d6edab9831d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:16:34.899426 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-faf265dc-1f0b-456a-bb01-7d6edab9831d None None] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:16:34.903055 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-faf265dc-1f0b-456a-bb01-7d6edab9831d None None] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:16:34.916117 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_db.sqlalchemy.engines [None req-faf265dc-1f0b-456a-bb01-7d6edab9831d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116863) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 24 09:16:34.918985 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_db.sqlalchemy.engines [None req-faf265dc-1f0b-456a-bb01-7d6edab9831d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116863) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 24 09:16:34.988505 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.context [None req-6905310e-3ea8-425a-b5b5-87e8c4ffebb8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3a4ccec5-1fee-4d4a-81eb-6ec950059a25(cell1) {{(pid=116864) load_cells /opt/stack/nova/nova/context.py:464}} Jan 24 09:16:34.995640 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6905310e-3ea8-425a-b5b5-87e8c4ffebb8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:16:34.998202 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6905310e-3ea8-425a-b5b5-87e8c4ffebb8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:16:34.999307 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6905310e-3ea8-425a-b5b5-87e8c4ffebb8 None None] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:16:35.001900 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6905310e-3ea8-425a-b5b5-87e8c4ffebb8 None None] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:16:35.019780 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_db.sqlalchemy.engines [None req-6905310e-3ea8-425a-b5b5-87e8c4ffebb8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116864) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 24 09:16:35.023407 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_db.sqlalchemy.engines [None req-6905310e-3ea8-425a-b5b5-87e8c4ffebb8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116864) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 24 09:16:35.129889 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_db.sqlalchemy.engines [None req-faf265dc-1f0b-456a-bb01-7d6edab9831d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116863) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 24 09:16:35.236114 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_db.sqlalchemy.engines [None req-6905310e-3ea8-425a-b5b5-87e8c4ffebb8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116864) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 24 09:16:35.521253 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: WARNING keystonemiddleware.auth_token [None req-faf265dc-1f0b-456a-bb01-7d6edab9831d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 24 09:16:35.528884 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: WARNING keystonemiddleware.auth_token [None req-faf265dc-1f0b-456a-bb01-7d6edab9831d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 24 09:16:35.620390 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: WARNING keystonemiddleware.auth_token [None req-6905310e-3ea8-425a-b5b5-87e8c4ffebb8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 24 09:16:35.627477 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: WARNING keystonemiddleware.auth_token [None req-6905310e-3ea8-425a-b5b5-87e8c4ffebb8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 24 09:16:35.874715 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: WARNING keystonemiddleware.auth_token [None req-faf265dc-1f0b-456a-bb01-7d6edab9831d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 24 09:16:35.885522 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: WARNING keystonemiddleware.auth_token [None req-faf265dc-1f0b-456a-bb01-7d6edab9831d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 24 09:16:35.891207 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: WSGI app 0 (mountpoint='') ready in 9 seconds on interpreter 0x561c41e0a9c0 pid: 116863 (default app) Jan 24 09:16:35.973973 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: WARNING keystonemiddleware.auth_token [None req-6905310e-3ea8-425a-b5b5-87e8c4ffebb8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 24 09:16:35.979292 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: WARNING keystonemiddleware.auth_token [None req-6905310e-3ea8-425a-b5b5-87e8c4ffebb8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 24 09:16:35.984646 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: WSGI app 0 (mountpoint='') ready in 9 seconds on interpreter 0x561c41e0a9c0 pid: 116864 (default app) Jan 24 09:17:10.156095 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-72164ca6-5d1e-44ee-b606-cf28a2b6de66 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1407202630", "imageRef": "c527e37f-a381-465e-babe-11528029ed9b", "flavorRef": "452", "networks": [{"uuid": "f23cf8c8-3b67-45ad-b576-35efecf70ce3"}]}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:17:10.281397 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-2a094af9-8fc2-4aaa-9556-4a56416cd3c1 tempest-VolumesNegativeTest-1136253760 tempest-VolumesNegativeTest-1136253760-project] Action: 'create', calling method: .version_select at 0x7f473faf4af0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1284457244", "metadata": {"Type": "work"}}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:17:10.281837 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-2a094af9-8fc2-4aaa-9556-4a56416cd3c1 tempest-VolumesNegativeTest-1136253760 tempest-VolumesNegativeTest-1136253760-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:17:10.282574 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-2a094af9-8fc2-4aaa-9556-4a56416cd3c1 tempest-VolumesNegativeTest-1136253760 tempest-VolumesNegativeTest-1136253760-project] 10.222.0.113 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.862946 Jan 24 09:17:10.284214 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 1/1] 10.222.0.113 () {60 vars in 1160 bytes} [Mon Jan 24 09:17:09 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 866 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 24 09:17:10.355380 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-02b5c3dd-4e40-4fd5-884f-d9493f403da4 tempest-VolumesSnapshotsTestJSON-219319307 tempest-VolumesSnapshotsTestJSON-219319307-project] Action: 'create', calling method: .version_select at 0x7f473fb13670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-511297157"}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:17:10.680686 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.network.neutron [None req-72164ca6-5d1e-44ee-b606-cf28a2b6de66 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] validate_networks() for [('f23cf8c8-3b67-45ad-b576-35efecf70ce3', None, None, None, None, None)] {{(pid=116863) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 09:17:11.845392 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.virt.hardware [None req-72164ca6-5d1e-44ee-b606-cf28a2b6de66 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Flavor limits 0:0:0 {{(pid=116863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 09:17:11.846819 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.virt.hardware [None req-72164ca6-5d1e-44ee-b606-cf28a2b6de66 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Image limits 0:0:0 {{(pid=116863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 09:17:11.847474 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.virt.hardware [None req-72164ca6-5d1e-44ee-b606-cf28a2b6de66 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Flavor pref 0:0:0 {{(pid=116863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 09:17:11.848087 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.virt.hardware [None req-72164ca6-5d1e-44ee-b606-cf28a2b6de66 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Image pref 0:0:0 {{(pid=116863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 09:17:11.849357 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.virt.hardware [None req-72164ca6-5d1e-44ee-b606-cf28a2b6de66 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 09:17:11.867883 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-72164ca6-5d1e-44ee-b606-cf28a2b6de66 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:11.868344 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-72164ca6-5d1e-44ee-b606-cf28a2b6de66 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:11.869163 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-72164ca6-5d1e-44ee-b606-cf28a2b6de66 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:11.870534 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-72164ca6-5d1e-44ee-b606-cf28a2b6de66 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:11.905506 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.quota [None req-72164ca6-5d1e-44ee-b606-cf28a2b6de66 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Getting quotas for project 31cb3477628042869ffe08048f0a8ee9. Resources: {'ram', 'cores', 'instances'} {{(pid=116863) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 09:17:11.912711 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.quota [None req-72164ca6-5d1e-44ee-b606-cf28a2b6de66 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Getting quotas for user 2eacf11b5ea94c6386577eca24696b99 and project 31cb3477628042869ffe08048f0a8ee9. Resources: {'ram', 'cores', 'instances'} {{(pid=116863) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 09:17:11.925609 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-72164ca6-5d1e-44ee-b606-cf28a2b6de66 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Going to run 1 instances... {{(pid=116863) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 09:17:11.929973 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-72164ca6-5d1e-44ee-b606-cf28a2b6de66 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] [instance: 8f231864-55f5-469d-b015-721a0ddc5e3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c527e37f-a381-465e-babe-11528029ed9b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 09:17:12.139635 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-02b5c3dd-4e40-4fd5-884f-d9493f403da4 tempest-VolumesSnapshotsTestJSON-219319307 tempest-VolumesSnapshotsTestJSON-219319307-project] 10.222.0.113 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.853848 Jan 24 09:17:12.140421 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 2/2] 10.222.0.113 () {60 vars in 1159 bytes} [Mon Jan 24 09:17:10 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1855 msecs (HTTP/1.1 200) 10 headers in 449 bytes (1 switches on core 0) Jan 24 09:17:12.153658 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-1c3bf1d8-d324-4725-be35-9787c1473b11 tempest-VolumesNegativeTest-1136253760 tempest-VolumesNegativeTest-1136253760-project] Action: 'create', calling method: .version_select at 0x7f473fb13c10>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-888555864", "metadata": {"Type": "work"}}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:17:12.155129 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-72164ca6-5d1e-44ee-b606-cf28a2b6de66 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 3.313431 Jan 24 09:17:12.156274 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-1c3bf1d8-d324-4725-be35-9787c1473b11 tempest-VolumesNegativeTest-1136253760 tempest-VolumesNegativeTest-1136253760-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:17:12.156418 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 1/3] 10.222.0.113 () {60 vars in 1151 bytes} [Mon Jan 24 09:17:08 2022] POST /compute/v2.1/servers => generated 382 bytes in 3320 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 24 09:17:12.157929 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-1c3bf1d8-d324-4725-be35-9787c1473b11 tempest-VolumesNegativeTest-1136253760 tempest-VolumesNegativeTest-1136253760-project] 10.222.0.113 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008355 Jan 24 09:17:12.165941 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-af1641d7-218f-40f3-9e94-79ddbb579f0b tempest-VolumesSnapshotsTestJSON-219319307 tempest-VolumesSnapshotsTestJSON-219319307-project] Calling method '.version_select at 0x7f473f0f5310>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:12.167735 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 3/4] 10.222.0.113 () {60 vars in 1160 bytes} [Mon Jan 24 09:17:12 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 24 09:17:12.173196 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-64a20151-bff3-440c-8d00-503d5ed1c7ff tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:12.176056 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-64a20151-bff3-440c-8d00-503d5ed1c7ff tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] [instance: 8f231864-55f5-469d-b015-721a0ddc5e3d] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:12.396149 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-64a20151-bff3-440c-8d00-503d5ed1c7ff tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eacf11b5ea94c6386577eca24696b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cb3477628042869ffe08048f0a8ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:12.417232 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-af1641d7-218f-40f3-9e94-79ddbb579f0b tempest-VolumesSnapshotsTestJSON-219319307 tempest-VolumesSnapshotsTestJSON-219319307-project] 10.222.0.113 "GET /compute/v2.1/os-volumes/ef26d208-b1a3-4824-a5e9-898bbd1522bb" status: 200 len: 344 microversion: 2.1 time: 0.258140 Jan 24 09:17:12.417232 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 2/5] 10.222.0.113 () {58 vars in 1249 bytes} [Mon Jan 24 09:17:12 2022] GET /compute/v2.1/os-volumes/ef26d208-b1a3-4824-a5e9-898bbd1522bb => generated 344 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:17:12.421673 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-99f91fab-81fc-4cdf-85d9-b47cc54f1b16 tempest-VolumesNegativeTest-1136253760 tempest-VolumesNegativeTest-1136253760-project] Action: 'create', calling method: .version_select at 0x7f473f0f5c10>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1535050693", "metadata": {"Type": "work"}}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:17:12.423656 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-99f91fab-81fc-4cdf-85d9-b47cc54f1b16 tempest-VolumesNegativeTest-1136253760 tempest-VolumesNegativeTest-1136253760-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:17:12.428390 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-99f91fab-81fc-4cdf-85d9-b47cc54f1b16 tempest-VolumesNegativeTest-1136253760 tempest-VolumesNegativeTest-1136253760-project] 10.222.0.113 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008251 Jan 24 09:17:12.429126 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 3/6] 10.222.0.113 () {60 vars in 1160 bytes} [Mon Jan 24 09:17:12 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 24 09:17:12.436716 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-64a20151-bff3-440c-8d00-503d5ed1c7ff tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] 10.222.0.113 "GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d" status: 200 len: 1219 microversion: 2.1 time: 0.265438 Jan 24 09:17:12.437663 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 4/7] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:12 2022] GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d => generated 1219 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:12.446416 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-b867b522-d44d-47c9-8035-bcfadd2274dd tempest-VolumesNegativeTest-1136253760 tempest-VolumesNegativeTest-1136253760-project] Calling method '.version_select at 0x7f473f98a310>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:12.552863 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.wsgi [None req-b867b522-d44d-47c9-8035-bcfadd2274dd tempest-VolumesNegativeTest-1136253760 tempest-VolumesNegativeTest-1136253760-project] HTTP exception thrown: Volume tempest-invalid-1644638763 could not be found. Jan 24 09:17:12.553463 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-b867b522-d44d-47c9-8035-bcfadd2274dd tempest-VolumesNegativeTest-1136253760 tempest-VolumesNegativeTest-1136253760-project] Returning 404 to user: Volume tempest-invalid-1644638763 could not be found. {{(pid=116864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:17:12.554327 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-b867b522-d44d-47c9-8035-bcfadd2274dd tempest-VolumesNegativeTest-1136253760 tempest-VolumesNegativeTest-1136253760-project] 10.222.0.113 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1644638763" status: 404 len: 99 microversion: 2.1 time: 0.115556 Jan 24 09:17:12.555807 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 5/8] 10.222.0.113 () {58 vars in 1222 bytes} [Mon Jan 24 09:17:12 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1644638763 => generated 99 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 24 09:17:12.568161 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-5be02fff-5a6e-4928-9ab7-894bbe3db9df tempest-VolumesNegativeTest-1136253760 tempest-VolumesNegativeTest-1136253760-project] 10.222.0.113 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004370 Jan 24 09:17:12.569199 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 6/9] 10.222.0.113 () {58 vars in 1144 bytes} [Mon Jan 24 09:17:12 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jan 24 09:17:12.579546 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-68988a8e-35ec-4ad4-a8a0-08bdaf794f10 tempest-VolumesNegativeTest-1136253760 tempest-VolumesNegativeTest-1136253760-project] 10.222.0.113 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004510 Jan 24 09:17:12.584000 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 7/10] 10.222.0.113 () {58 vars in 1141 bytes} [Mon Jan 24 09:17:12 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 24 09:17:12.602725 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-443571b2-f724-4ea9-b0db-592c4cf7c5ce tempest-VolumesNegativeTest-1136253760 tempest-VolumesNegativeTest-1136253760-project] Calling method '.version_select at 0x7f473f98a280>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:12.652227 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-db773fbf-8252-4e62-8ab4-87504efdf653 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1434139266", "imageRef": "c527e37f-a381-465e-babe-11528029ed9b", "flavorRef": "452", "networks": [{"uuid": "595abfef-3114-4487-9adf-a62cd7425c5d"}]}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:17:12.661649 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.wsgi [None req-443571b2-f724-4ea9-b0db-592c4cf7c5ce tempest-VolumesNegativeTest-1136253760 tempest-VolumesNegativeTest-1136253760-project] HTTP exception thrown: Volume 94a45937-dcbf-4d6b-aa96-664d3748fbe6 could not be found. Jan 24 09:17:12.662565 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-443571b2-f724-4ea9-b0db-592c4cf7c5ce tempest-VolumesNegativeTest-1136253760 tempest-VolumesNegativeTest-1136253760-project] Returning 404 to user: Volume 94a45937-dcbf-4d6b-aa96-664d3748fbe6 could not be found. {{(pid=116864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:17:12.663720 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-443571b2-f724-4ea9-b0db-592c4cf7c5ce tempest-VolumesNegativeTest-1136253760 tempest-VolumesNegativeTest-1136253760-project] 10.222.0.113 "DELETE /compute/v2.1/os-volumes/94a45937-dcbf-4d6b-aa96-664d3748fbe6" status: 404 len: 109 microversion: 2.1 time: 0.066932 Jan 24 09:17:12.664464 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 8/11] 10.222.0.113 () {58 vars in 1252 bytes} [Mon Jan 24 09:17:12 2022] DELETE /compute/v2.1/os-volumes/94a45937-dcbf-4d6b-aa96-664d3748fbe6 => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 24 09:17:12.674483 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-8847ced9-fe1f-4aae-a92a-8954e2bcfdb9 tempest-VolumesNegativeTest-1136253760 tempest-VolumesNegativeTest-1136253760-project] Calling method '.version_select at 0x7f473f9278b0>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:12.734122 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.wsgi [None req-8847ced9-fe1f-4aae-a92a-8954e2bcfdb9 tempest-VolumesNegativeTest-1136253760 tempest-VolumesNegativeTest-1136253760-project] HTTP exception thrown: Volume f010351d-7c19-4042-bf6e-facc513f1f9f could not be found. Jan 24 09:17:12.734733 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-8847ced9-fe1f-4aae-a92a-8954e2bcfdb9 tempest-VolumesNegativeTest-1136253760 tempest-VolumesNegativeTest-1136253760-project] Returning 404 to user: Volume f010351d-7c19-4042-bf6e-facc513f1f9f could not be found. {{(pid=116864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:17:12.735580 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-8847ced9-fe1f-4aae-a92a-8954e2bcfdb9 tempest-VolumesNegativeTest-1136253760 tempest-VolumesNegativeTest-1136253760-project] 10.222.0.113 "GET /compute/v2.1/os-volumes/f010351d-7c19-4042-bf6e-facc513f1f9f" status: 404 len: 109 microversion: 2.1 time: 0.065116 Jan 24 09:17:12.736132 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 9/12] 10.222.0.113 () {58 vars in 1249 bytes} [Mon Jan 24 09:17:12 2022] GET /compute/v2.1/os-volumes/f010351d-7c19-4042-bf6e-facc513f1f9f => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 09:17:12.747892 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.network.neutron [None req-db773fbf-8252-4e62-8ab4-87504efdf653 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] validate_networks() for [('595abfef-3114-4487-9adf-a62cd7425c5d', None, None, None, None, None)] {{(pid=116863) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 09:17:13.430186 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-9fb01221-d416-4b42-b411-4842cf25def3 tempest-VolumesSnapshotsTestJSON-219319307 tempest-VolumesSnapshotsTestJSON-219319307-project] Calling method '.version_select at 0x7f473f927c10>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:13.528325 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-9fb01221-d416-4b42-b411-4842cf25def3 tempest-VolumesSnapshotsTestJSON-219319307 tempest-VolumesSnapshotsTestJSON-219319307-project] 10.222.0.113 "GET /compute/v2.1/os-volumes/ef26d208-b1a3-4824-a5e9-898bbd1522bb" status: 200 len: 344 microversion: 2.1 time: 0.103342 Jan 24 09:17:13.529127 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 10/13] 10.222.0.113 () {58 vars in 1249 bytes} [Mon Jan 24 09:17:13 2022] GET /compute/v2.1/os-volumes/ef26d208-b1a3-4824-a5e9-898bbd1522bb => generated 344 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:17:13.537192 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-1636d69c-f4be-4d7d-b026-83b6a1761bff tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:13.538413 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-1636d69c-f4be-4d7d-b026-83b6a1761bff tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] [instance: 8f231864-55f5-469d-b015-721a0ddc5e3d] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:13.800201 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-1636d69c-f4be-4d7d-b026-83b6a1761bff tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eacf11b5ea94c6386577eca24696b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cb3477628042869ffe08048f0a8ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:13.811789 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-1636d69c-f4be-4d7d-b026-83b6a1761bff tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] 10.222.0.113 "GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d" status: 200 len: 1219 microversion: 2.1 time: 0.280922 Jan 24 09:17:13.813615 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 11/14] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:13 2022] GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d => generated 1219 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:13.920049 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.virt.hardware [None req-db773fbf-8252-4e62-8ab4-87504efdf653 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Flavor limits 0:0:0 {{(pid=116863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 09:17:13.920507 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.virt.hardware [None req-db773fbf-8252-4e62-8ab4-87504efdf653 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Image limits 0:0:0 {{(pid=116863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 09:17:13.920895 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.virt.hardware [None req-db773fbf-8252-4e62-8ab4-87504efdf653 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Flavor pref 0:0:0 {{(pid=116863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 09:17:13.921303 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.virt.hardware [None req-db773fbf-8252-4e62-8ab4-87504efdf653 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Image pref 0:0:0 {{(pid=116863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 09:17:13.921713 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.virt.hardware [None req-db773fbf-8252-4e62-8ab4-87504efdf653 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 09:17:13.935702 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-db773fbf-8252-4e62-8ab4-87504efdf653 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:13.936175 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-db773fbf-8252-4e62-8ab4-87504efdf653 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:13.936965 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-db773fbf-8252-4e62-8ab4-87504efdf653 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:13.937400 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-db773fbf-8252-4e62-8ab4-87504efdf653 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:13.956971 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.quota [None req-db773fbf-8252-4e62-8ab4-87504efdf653 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Getting quotas for project 9effc220352541ecba9f319db87235de. Resources: {'ram', 'cores', 'instances'} {{(pid=116863) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 09:17:13.962834 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.quota [None req-db773fbf-8252-4e62-8ab4-87504efdf653 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Getting quotas for user 49d33f34357f4132b712dff54a6446f3 and project 9effc220352541ecba9f319db87235de. Resources: {'ram', 'cores', 'instances'} {{(pid=116863) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 09:17:13.981044 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-db773fbf-8252-4e62-8ab4-87504efdf653 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Going to run 1 instances... {{(pid=116863) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 09:17:13.981044 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-db773fbf-8252-4e62-8ab4-87504efdf653 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 334e86b7-8556-46c7-aad6-e5b2af845691] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c527e37f-a381-465e-babe-11528029ed9b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 09:17:14.201275 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-db773fbf-8252-4e62-8ab4-87504efdf653 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.770732 Jan 24 09:17:14.211259 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 4/15] 10.222.0.113 () {60 vars in 1151 bytes} [Mon Jan 24 09:17:12 2022] POST /compute/v2.1/servers => generated 382 bytes in 1781 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 24 09:17:14.217695 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-7c274b45-5b49-42f1-90f7-4adf1f0f7410 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:14.219040 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-7c274b45-5b49-42f1-90f7-4adf1f0f7410 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 334e86b7-8556-46c7-aad6-e5b2af845691] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:14.376233 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-7c274b45-5b49-42f1-90f7-4adf1f0f7410 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:14.394172 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-7c274b45-5b49-42f1-90f7-4adf1f0f7410 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691" status: 200 len: 1222 microversion: 2.1 time: 0.181650 Jan 24 09:17:14.404747 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 12/16] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:14 2022] GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691 => generated 1222 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:17:14.556684 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-50f8ed74-d5b3-486c-a331-c84f7d21427a tempest-VolumesSnapshotsTestJSON-219319307 tempest-VolumesSnapshotsTestJSON-219319307-project] Calling method '.version_select at 0x7f473e86b280>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:14.665858 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-50f8ed74-d5b3-486c-a331-c84f7d21427a tempest-VolumesSnapshotsTestJSON-219319307 tempest-VolumesSnapshotsTestJSON-219319307-project] 10.222.0.113 "GET /compute/v2.1/os-volumes/ef26d208-b1a3-4824-a5e9-898bbd1522bb" status: 200 len: 345 microversion: 2.1 time: 0.127903 Jan 24 09:17:14.667739 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 5/17] 10.222.0.113 () {58 vars in 1249 bytes} [Mon Jan 24 09:17:14 2022] GET /compute/v2.1/os-volumes/ef26d208-b1a3-4824-a5e9-898bbd1522bb => generated 345 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:17:14.681532 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-695d976e-65cd-424f-bbdb-52c5c8d34b52 tempest-VolumesSnapshotsTestJSON-219319307 tempest-VolumesSnapshotsTestJSON-219319307-project] Action: 'create', calling method: .version_select at 0x7f473f934430>, body: {"snapshot": {"volume_id": "ef26d208-b1a3-4824-a5e9-898bbd1522bb", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-746961411"}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:17:14.832750 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-ccf7ca99-6a08-4708-aa4c-172480382194 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:14.834380 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-ccf7ca99-6a08-4708-aa4c-172480382194 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] [instance: 8f231864-55f5-469d-b015-721a0ddc5e3d] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:14.949711 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-ccf7ca99-6a08-4708-aa4c-172480382194 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eacf11b5ea94c6386577eca24696b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cb3477628042869ffe08048f0a8ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:14.981048 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-ccf7ca99-6a08-4708-aa4c-172480382194 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] 10.222.0.113 "GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d" status: 200 len: 1219 microversion: 2.1 time: 0.153077 Jan 24 09:17:14.981706 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 6/18] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:14 2022] GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d => generated 1219 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:17:15.415569 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-6444e12b-01e7-429e-9112-c817a7826987 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:15.416440 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-6444e12b-01e7-429e-9112-c817a7826987 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 334e86b7-8556-46c7-aad6-e5b2af845691] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:15.662338 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-695d976e-65cd-424f-bbdb-52c5c8d34b52 tempest-VolumesSnapshotsTestJSON-219319307 tempest-VolumesSnapshotsTestJSON-219319307-project] 10.222.0.113 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.987526 Jan 24 09:17:15.663907 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 13/19] 10.222.0.113 () {60 vars in 1166 bytes} [Mon Jan 24 09:17:14 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:17:15.672933 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-00fc3fb1-5cb6-4907-a542-d3ec0f12a94b tempest-VolumesSnapshotsTestJSON-219319307 tempest-VolumesSnapshotsTestJSON-219319307-project] Calling method '.version_select at 0x7f473f940160>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:15.722972 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-6444e12b-01e7-429e-9112-c817a7826987 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:15.742592 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-6444e12b-01e7-429e-9112-c817a7826987 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691" status: 200 len: 1222 microversion: 2.1 time: 0.331887 Jan 24 09:17:15.757157 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 7/20] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:15 2022] GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691 => generated 1222 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:15.881644 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-00fc3fb1-5cb6-4907-a542-d3ec0f12a94b tempest-VolumesSnapshotsTestJSON-219319307 tempest-VolumesSnapshotsTestJSON-219319307-project] 10.222.0.113 "GET /compute/v2.1/os-snapshots/aa731af6-f421-4657-af9f-34a9e562d166" status: 200 len: 286 microversion: 2.1 time: 0.210537 Jan 24 09:17:15.883592 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 14/21] 10.222.0.113 () {58 vars in 1255 bytes} [Mon Jan 24 09:17:15 2022] GET /compute/v2.1/os-snapshots/aa731af6-f421-4657-af9f-34a9e562d166 => generated 286 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:17:15.893039 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-14d10ea3-7423-4b3f-8f3a-83fe0891c99e tempest-VolumesSnapshotsTestJSON-219319307 tempest-VolumesSnapshotsTestJSON-219319307-project] Calling method '.version_select at 0x7f473e893b80>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:15.986350 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-14d10ea3-7423-4b3f-8f3a-83fe0891c99e tempest-VolumesSnapshotsTestJSON-219319307 tempest-VolumesSnapshotsTestJSON-219319307-project] 10.222.0.113 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.096979 Jan 24 09:17:15.990323 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 8/22] 10.222.0.113 () {58 vars in 1144 bytes} [Mon Jan 24 09:17:15 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:17:15.999290 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-51d94c2d-4524-4cf7-b126-1acd58a3630f tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:16.000062 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-51d94c2d-4524-4cf7-b126-1acd58a3630f tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] [instance: 8f231864-55f5-469d-b015-721a0ddc5e3d] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:16.001414 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-45158217-e10c-4d77-94cf-60e3a5e13770 tempest-VolumesSnapshotsTestJSON-219319307 tempest-VolumesSnapshotsTestJSON-219319307-project] Calling method '.version_select at 0x7f473e88dc10>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:16.009464 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-51d94c2d-4524-4cf7-b126-1acd58a3630f tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:16.010316 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-51d94c2d-4524-4cf7-b126-1acd58a3630f tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:16.011954 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-51d94c2d-4524-4cf7-b126-1acd58a3630f tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:16.012470 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-51d94c2d-4524-4cf7-b126-1acd58a3630f tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:16.067498 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-45158217-e10c-4d77-94cf-60e3a5e13770 tempest-VolumesSnapshotsTestJSON-219319307 tempest-VolumesSnapshotsTestJSON-219319307-project] 10.222.0.113 "GET /compute/v2.1/os-snapshots/aa731af6-f421-4657-af9f-34a9e562d166" status: 200 len: 286 microversion: 2.1 time: 0.071400 Jan 24 09:17:16.068181 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 9/23] 10.222.0.113 () {58 vars in 1255 bytes} [Mon Jan 24 09:17:15 2022] GET /compute/v2.1/os-snapshots/aa731af6-f421-4657-af9f-34a9e562d166 => generated 286 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 09:17:16.269123 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-51d94c2d-4524-4cf7-b126-1acd58a3630f tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eacf11b5ea94c6386577eca24696b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cb3477628042869ffe08048f0a8ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:16.295985 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-51d94c2d-4524-4cf7-b126-1acd58a3630f tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] 10.222.0.113 "GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d" status: 200 len: 1215 microversion: 2.1 time: 0.301634 Jan 24 09:17:16.296515 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 15/24] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:15 2022] GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d => generated 1215 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:16.766259 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-e6505ca6-f317-41e1-9898-80f64efe6740 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:16.771422 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-e6505ca6-f317-41e1-9898-80f64efe6740 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 334e86b7-8556-46c7-aad6-e5b2af845691] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:16.859633 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-e6505ca6-f317-41e1-9898-80f64efe6740 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:16.869943 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-e6505ca6-f317-41e1-9898-80f64efe6740 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691" status: 200 len: 1222 microversion: 2.1 time: 0.108768 Jan 24 09:17:16.870704 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 10/25] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:16 2022] GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691 => generated 1222 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:17.079546 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-d3b1d4b0-56c7-479e-a25d-399a316afa39 tempest-VolumesSnapshotsTestJSON-219319307 tempest-VolumesSnapshotsTestJSON-219319307-project] Calling method '.version_select at 0x7f473f8a1dc0>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:17.118934 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-d3b1d4b0-56c7-479e-a25d-399a316afa39 tempest-VolumesSnapshotsTestJSON-219319307 tempest-VolumesSnapshotsTestJSON-219319307-project] 10.222.0.113 "GET /compute/v2.1/os-snapshots/aa731af6-f421-4657-af9f-34a9e562d166" status: 200 len: 286 microversion: 2.1 time: 0.043566 Jan 24 09:17:17.120616 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 16/26] 10.222.0.113 () {58 vars in 1255 bytes} [Mon Jan 24 09:17:17 2022] GET /compute/v2.1/os-snapshots/aa731af6-f421-4657-af9f-34a9e562d166 => generated 286 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:17:17.316971 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-43ac3b01-396f-407b-b54f-d8d5d53cc46b tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:17.319709 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-43ac3b01-396f-407b-b54f-d8d5d53cc46b tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] [instance: 8f231864-55f5-469d-b015-721a0ddc5e3d] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:17.338646 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-43ac3b01-396f-407b-b54f-d8d5d53cc46b tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:17.339385 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-43ac3b01-396f-407b-b54f-d8d5d53cc46b tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:17.340250 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-43ac3b01-396f-407b-b54f-d8d5d53cc46b tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:17.340804 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-43ac3b01-396f-407b-b54f-d8d5d53cc46b tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:17.877903 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-43ac3b01-396f-407b-b54f-d8d5d53cc46b tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eacf11b5ea94c6386577eca24696b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cb3477628042869ffe08048f0a8ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:17.877903 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-43ac3b01-396f-407b-b54f-d8d5d53cc46b tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] 10.222.0.113 "GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d" status: 200 len: 1271 microversion: 2.1 time: 0.331104 Jan 24 09:17:17.877903 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 11/27] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:17 2022] GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d => generated 1271 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:17.888664 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-14aa2835-fe2d-4045-a20b-01bf9a0fdd7c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:17.889698 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-14aa2835-fe2d-4045-a20b-01bf9a0fdd7c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 334e86b7-8556-46c7-aad6-e5b2af845691] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:17.899558 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-14aa2835-fe2d-4045-a20b-01bf9a0fdd7c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:17.901125 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-14aa2835-fe2d-4045-a20b-01bf9a0fdd7c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:17.905001 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-14aa2835-fe2d-4045-a20b-01bf9a0fdd7c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:17.905716 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-14aa2835-fe2d-4045-a20b-01bf9a0fdd7c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:18.136358 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-14aa2835-fe2d-4045-a20b-01bf9a0fdd7c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:18.136963 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-0969089e-7fa1-4fe4-9f03-04aa130c49db tempest-VolumesSnapshotsTestJSON-219319307 tempest-VolumesSnapshotsTestJSON-219319307-project] Calling method '.version_select at 0x7f473e7bed30>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:18.138867 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-14aa2835-fe2d-4045-a20b-01bf9a0fdd7c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691" status: 200 len: 1226 microversion: 2.1 time: 0.254361 Jan 24 09:17:18.141942 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 17/28] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:17 2022] GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691 => generated 1226 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:18.187988 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-0969089e-7fa1-4fe4-9f03-04aa130c49db tempest-VolumesSnapshotsTestJSON-219319307 tempest-VolumesSnapshotsTestJSON-219319307-project] 10.222.0.113 "GET /compute/v2.1/os-snapshots/aa731af6-f421-4657-af9f-34a9e562d166" status: 200 len: 286 microversion: 2.1 time: 0.059637 Jan 24 09:17:18.188729 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 12/29] 10.222.0.113 () {58 vars in 1255 bytes} [Mon Jan 24 09:17:18 2022] GET /compute/v2.1/os-snapshots/aa731af6-f421-4657-af9f-34a9e562d166 => generated 286 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:17:18.662530 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-c18fe789-3018-47ae-a9ee-b9447cb83f33 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:18.663546 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-c18fe789-3018-47ae-a9ee-b9447cb83f33 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] [instance: 8f231864-55f5-469d-b015-721a0ddc5e3d] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:18.673553 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c18fe789-3018-47ae-a9ee-b9447cb83f33 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:18.674002 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c18fe789-3018-47ae-a9ee-b9447cb83f33 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:18.675018 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c18fe789-3018-47ae-a9ee-b9447cb83f33 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:18.675638 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c18fe789-3018-47ae-a9ee-b9447cb83f33 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:18.759772 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-c18fe789-3018-47ae-a9ee-b9447cb83f33 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eacf11b5ea94c6386577eca24696b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cb3477628042869ffe08048f0a8ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:18.771295 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-c18fe789-3018-47ae-a9ee-b9447cb83f33 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] 10.222.0.113 "GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d" status: 200 len: 1271 microversion: 2.1 time: 0.111510 Jan 24 09:17:18.771708 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 18/30] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:18 2022] GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d => generated 1271 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:19.156217 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-d7df9a91-fcb4-46f6-be53-43345d7b34d8 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:19.156768 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-d7df9a91-fcb4-46f6-be53-43345d7b34d8 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 334e86b7-8556-46c7-aad6-e5b2af845691] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:19.173778 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d7df9a91-fcb4-46f6-be53-43345d7b34d8 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:19.174252 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d7df9a91-fcb4-46f6-be53-43345d7b34d8 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:19.175060 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d7df9a91-fcb4-46f6-be53-43345d7b34d8 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:19.175496 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d7df9a91-fcb4-46f6-be53-43345d7b34d8 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:19.202236 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-0d4f67c3-2df6-467a-934b-289913c82e99 tempest-VolumesSnapshotsTestJSON-219319307 tempest-VolumesSnapshotsTestJSON-219319307-project] Calling method '.version_select at 0x7f473f8a1ee0>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:19.276415 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-0d4f67c3-2df6-467a-934b-289913c82e99 tempest-VolumesSnapshotsTestJSON-219319307 tempest-VolumesSnapshotsTestJSON-219319307-project] 10.222.0.113 "GET /compute/v2.1/os-snapshots/aa731af6-f421-4657-af9f-34a9e562d166" status: 200 len: 286 microversion: 2.1 time: 0.079706 Jan 24 09:17:19.277395 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 19/31] 10.222.0.113 () {58 vars in 1255 bytes} [Mon Jan 24 09:17:19 2022] GET /compute/v2.1/os-snapshots/aa731af6-f421-4657-af9f-34a9e562d166 => generated 286 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:17:19.323171 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-d7df9a91-fcb4-46f6-be53-43345d7b34d8 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:19.332301 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-d7df9a91-fcb4-46f6-be53-43345d7b34d8 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691" status: 200 len: 1226 microversion: 2.1 time: 0.178082 Jan 24 09:17:19.334711 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 13/32] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:19 2022] GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691 => generated 1226 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:19.791029 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-4f1b9ac9-c0fe-46e5-bc36-42a8ac89bef8 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:19.794196 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-4f1b9ac9-c0fe-46e5-bc36-42a8ac89bef8 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] [instance: 8f231864-55f5-469d-b015-721a0ddc5e3d] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:19.806143 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4f1b9ac9-c0fe-46e5-bc36-42a8ac89bef8 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:19.809996 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4f1b9ac9-c0fe-46e5-bc36-42a8ac89bef8 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:19.814211 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4f1b9ac9-c0fe-46e5-bc36-42a8ac89bef8 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:19.816190 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4f1b9ac9-c0fe-46e5-bc36-42a8ac89bef8 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:20.023515 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-4f1b9ac9-c0fe-46e5-bc36-42a8ac89bef8 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eacf11b5ea94c6386577eca24696b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cb3477628042869ffe08048f0a8ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:20.043814 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-4f1b9ac9-c0fe-46e5-bc36-42a8ac89bef8 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] 10.222.0.113 "GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d" status: 200 len: 1279 microversion: 2.1 time: 0.259979 Jan 24 09:17:20.044522 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 20/33] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:19 2022] GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d => generated 1279 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:20.288835 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-c92e51f6-582f-4714-9ee5-b474a62a1b82 tempest-VolumesSnapshotsTestJSON-219319307 tempest-VolumesSnapshotsTestJSON-219319307-project] Calling method '.version_select at 0x7f473e7fbdc0>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:20.351990 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-dc43574c-4d8b-4939-89ae-e2e40a091078 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:20.353383 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-dc43574c-4d8b-4939-89ae-e2e40a091078 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 334e86b7-8556-46c7-aad6-e5b2af845691] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:20.377506 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-dc43574c-4d8b-4939-89ae-e2e40a091078 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:20.380006 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-dc43574c-4d8b-4939-89ae-e2e40a091078 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:20.382080 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-dc43574c-4d8b-4939-89ae-e2e40a091078 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:20.383489 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-dc43574c-4d8b-4939-89ae-e2e40a091078 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:20.402881 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-c92e51f6-582f-4714-9ee5-b474a62a1b82 tempest-VolumesSnapshotsTestJSON-219319307 tempest-VolumesSnapshotsTestJSON-219319307-project] 10.222.0.113 "GET /compute/v2.1/os-snapshots/aa731af6-f421-4657-af9f-34a9e562d166" status: 200 len: 287 microversion: 2.1 time: 0.118268 Jan 24 09:17:20.403729 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 14/34] 10.222.0.113 () {58 vars in 1255 bytes} [Mon Jan 24 09:17:20 2022] GET /compute/v2.1/os-snapshots/aa731af6-f421-4657-af9f-34a9e562d166 => generated 287 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:17:20.418975 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-06acf8ae-9671-4e32-ba32-3cf3890d56bd tempest-VolumesSnapshotsTestJSON-219319307 tempest-VolumesSnapshotsTestJSON-219319307-project] Calling method '.version_select at 0x7f473e760040>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:20.563153 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-dc43574c-4d8b-4939-89ae-e2e40a091078 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:20.579497 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-dc43574c-4d8b-4939-89ae-e2e40a091078 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691" status: 200 len: 1274 microversion: 2.1 time: 0.232370 Jan 24 09:17:20.590115 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 21/35] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:20 2022] GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691 => generated 1274 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:20.678651 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-06acf8ae-9671-4e32-ba32-3cf3890d56bd tempest-VolumesSnapshotsTestJSON-219319307 tempest-VolumesSnapshotsTestJSON-219319307-project] 10.222.0.113 "DELETE /compute/v2.1/os-snapshots/aa731af6-f421-4657-af9f-34a9e562d166" status: 202 len: 0 microversion: 2.1 time: 0.263246 Jan 24 09:17:20.679512 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 15/36] 10.222.0.113 () {58 vars in 1258 bytes} [Mon Jan 24 09:17:20 2022] DELETE /compute/v2.1/os-snapshots/aa731af6-f421-4657-af9f-34a9e562d166 => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 24 09:17:20.690065 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-f427f902-775a-4bdc-9bbf-f75e807c6f2b tempest-VolumesSnapshotsTestJSON-219319307 tempest-VolumesSnapshotsTestJSON-219319307-project] Calling method '.version_select at 0x7f473f8905e0>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:20.749894 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-f427f902-775a-4bdc-9bbf-f75e807c6f2b tempest-VolumesSnapshotsTestJSON-219319307 tempest-VolumesSnapshotsTestJSON-219319307-project] 10.222.0.113 "GET /compute/v2.1/os-snapshots/aa731af6-f421-4657-af9f-34a9e562d166" status: 200 len: 286 microversion: 2.1 time: 0.064375 Jan 24 09:17:20.750862 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 22/37] 10.222.0.113 () {58 vars in 1255 bytes} [Mon Jan 24 09:17:20 2022] GET /compute/v2.1/os-snapshots/aa731af6-f421-4657-af9f-34a9e562d166 => generated 286 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:17:21.061752 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-382370bd-5084-4368-9a9e-e38f962f4896 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:21.062885 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-382370bd-5084-4368-9a9e-e38f962f4896 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] [instance: 8f231864-55f5-469d-b015-721a0ddc5e3d] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:21.076196 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-382370bd-5084-4368-9a9e-e38f962f4896 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:21.076662 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-382370bd-5084-4368-9a9e-e38f962f4896 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:21.077538 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-382370bd-5084-4368-9a9e-e38f962f4896 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:21.077984 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-382370bd-5084-4368-9a9e-e38f962f4896 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:21.281070 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-382370bd-5084-4368-9a9e-e38f962f4896 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eacf11b5ea94c6386577eca24696b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cb3477628042869ffe08048f0a8ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:21.301987 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-382370bd-5084-4368-9a9e-e38f962f4896 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] 10.222.0.113 "GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d" status: 200 len: 1277 microversion: 2.1 time: 0.237828 Jan 24 09:17:21.303458 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 16/38] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:21 2022] GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d => generated 1277 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:21.597889 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-72ff400f-163a-4b44-a177-e4255eb93dc4 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:21.599784 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-72ff400f-163a-4b44-a177-e4255eb93dc4 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 334e86b7-8556-46c7-aad6-e5b2af845691] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:21.615966 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-72ff400f-163a-4b44-a177-e4255eb93dc4 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:21.616425 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-72ff400f-163a-4b44-a177-e4255eb93dc4 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:21.621092 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-72ff400f-163a-4b44-a177-e4255eb93dc4 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:21.622781 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-72ff400f-163a-4b44-a177-e4255eb93dc4 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:21.762703 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-7643c937-e23f-417b-ab7e-90e130544995 tempest-VolumesSnapshotsTestJSON-219319307 tempest-VolumesSnapshotsTestJSON-219319307-project] Calling method '.version_select at 0x7f473e760700>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:21.817566 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.wsgi [None req-7643c937-e23f-417b-ab7e-90e130544995 tempest-VolumesSnapshotsTestJSON-219319307 tempest-VolumesSnapshotsTestJSON-219319307-project] HTTP exception thrown: Snapshot aa731af6-f421-4657-af9f-34a9e562d166 could not be found. Jan 24 09:17:21.818459 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-7643c937-e23f-417b-ab7e-90e130544995 tempest-VolumesSnapshotsTestJSON-219319307 tempest-VolumesSnapshotsTestJSON-219319307-project] Returning 404 to user: Snapshot aa731af6-f421-4657-af9f-34a9e562d166 could not be found. {{(pid=116863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:17:21.822027 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-7643c937-e23f-417b-ab7e-90e130544995 tempest-VolumesSnapshotsTestJSON-219319307 tempest-VolumesSnapshotsTestJSON-219319307-project] 10.222.0.113 "GET /compute/v2.1/os-snapshots/aa731af6-f421-4657-af9f-34a9e562d166" status: 404 len: 111 microversion: 2.1 time: 0.062324 Jan 24 09:17:21.828161 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 17/39] 10.222.0.113 () {58 vars in 1255 bytes} [Mon Jan 24 09:17:21 2022] GET /compute/v2.1/os-snapshots/aa731af6-f421-4657-af9f-34a9e562d166 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 09:17:21.854325 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-35ab78dc-afd2-4418-bddc-58f75a1fd268 tempest-VolumesSnapshotsTestJSON-219319307 tempest-VolumesSnapshotsTestJSON-219319307-project] Calling method '.version_select at 0x7f473f0f5ee0>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:21.949941 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-72ff400f-163a-4b44-a177-e4255eb93dc4 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:21.956304 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-72ff400f-163a-4b44-a177-e4255eb93dc4 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691" status: 200 len: 1280 microversion: 2.1 time: 0.362993 Jan 24 09:17:21.956896 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 23/40] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:21 2022] GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691 => generated 1280 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:22.241685 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-35ab78dc-afd2-4418-bddc-58f75a1fd268 tempest-VolumesSnapshotsTestJSON-219319307 tempest-VolumesSnapshotsTestJSON-219319307-project] 10.222.0.113 "DELETE /compute/v2.1/os-volumes/ef26d208-b1a3-4824-a5e9-898bbd1522bb" status: 202 len: 0 microversion: 2.1 time: 0.407378 Jan 24 09:17:22.242625 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 18/41] 10.222.0.113 () {58 vars in 1252 bytes} [Mon Jan 24 09:17:21 2022] DELETE /compute/v2.1/os-volumes/ef26d208-b1a3-4824-a5e9-898bbd1522bb => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:17:22.250567 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-7a559c96-8489-46f8-9415-0f6171930fd7 tempest-VolumesSnapshotsTestJSON-219319307 tempest-VolumesSnapshotsTestJSON-219319307-project] Calling method '.version_select at 0x7f473f890160>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:22.320306 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-f8adccfd-2eca-49b2-8fac-33747117c867 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:22.325904 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-f8adccfd-2eca-49b2-8fac-33747117c867 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] [instance: 8f231864-55f5-469d-b015-721a0ddc5e3d] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:22.332138 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f8adccfd-2eca-49b2-8fac-33747117c867 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:22.333202 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f8adccfd-2eca-49b2-8fac-33747117c867 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:22.339369 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f8adccfd-2eca-49b2-8fac-33747117c867 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:22.340061 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f8adccfd-2eca-49b2-8fac-33747117c867 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:22.504151 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-7a559c96-8489-46f8-9415-0f6171930fd7 tempest-VolumesSnapshotsTestJSON-219319307 tempest-VolumesSnapshotsTestJSON-219319307-project] 10.222.0.113 "GET /compute/v2.1/os-volumes/ef26d208-b1a3-4824-a5e9-898bbd1522bb" status: 200 len: 344 microversion: 2.1 time: 0.257159 Jan 24 09:17:22.504932 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 24/42] 10.222.0.113 () {58 vars in 1249 bytes} [Mon Jan 24 09:17:22 2022] GET /compute/v2.1/os-volumes/ef26d208-b1a3-4824-a5e9-898bbd1522bb => generated 344 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 09:17:22.899812 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-f8adccfd-2eca-49b2-8fac-33747117c867 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eacf11b5ea94c6386577eca24696b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cb3477628042869ffe08048f0a8ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:22.916317 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-f8adccfd-2eca-49b2-8fac-33747117c867 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] 10.222.0.113 "GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d" status: 200 len: 1277 microversion: 2.1 time: 0.592150 Jan 24 09:17:22.918373 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 19/43] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:22 2022] GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d => generated 1277 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:17:22.977390 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-4c5de7ac-e434-4c66-8f9a-272908b5b4d3 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:22.978681 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-4c5de7ac-e434-4c66-8f9a-272908b5b4d3 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 334e86b7-8556-46c7-aad6-e5b2af845691] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:23.007635 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4c5de7ac-e434-4c66-8f9a-272908b5b4d3 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:23.009173 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4c5de7ac-e434-4c66-8f9a-272908b5b4d3 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:23.012105 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4c5de7ac-e434-4c66-8f9a-272908b5b4d3 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:23.015075 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4c5de7ac-e434-4c66-8f9a-272908b5b4d3 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:23.519958 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-4c5de7ac-e434-4c66-8f9a-272908b5b4d3 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:23.546673 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-4c5de7ac-e434-4c66-8f9a-272908b5b4d3 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691" status: 200 len: 1280 microversion: 2.1 time: 0.575144 Jan 24 09:17:23.559289 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 25/44] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:22 2022] GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691 => generated 1280 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:17:23.577250 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-aabfb6e1-69f8-4b94-870d-3eacca04d974 tempest-VolumesSnapshotsTestJSON-219319307 tempest-VolumesSnapshotsTestJSON-219319307-project] Calling method '.version_select at 0x7f473f8909d0>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:23.687075 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-4da816a0-cbdb-4815-8470-b53f770e7900 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'create', calling method: .version_select at 0x7f473e80fe50>, body: {"keypair": {"name": "tempest-keypair-437373915"}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:17:23.764965 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.quota [None req-4da816a0-cbdb-4815-8470-b53f770e7900 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Getting quotas for project 94bb7ee37f9545c7a38065c3e1a3b6c1. Resources: {'key_pairs'} {{(pid=116863) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 09:17:23.771635 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.quota [None req-4da816a0-cbdb-4815-8470-b53f770e7900 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Getting quotas for user 3527d1517fb0466a8b6375e40870b474 and project 94bb7ee37f9545c7a38065c3e1a3b6c1. Resources: {'key_pairs'} {{(pid=116863) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 09:17:24.252272 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.wsgi [None req-aabfb6e1-69f8-4b94-870d-3eacca04d974 tempest-VolumesSnapshotsTestJSON-219319307 tempest-VolumesSnapshotsTestJSON-219319307-project] HTTP exception thrown: Volume ef26d208-b1a3-4824-a5e9-898bbd1522bb could not be found. Jan 24 09:17:24.255607 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-aabfb6e1-69f8-4b94-870d-3eacca04d974 tempest-VolumesSnapshotsTestJSON-219319307 tempest-VolumesSnapshotsTestJSON-219319307-project] Returning 404 to user: Volume ef26d208-b1a3-4824-a5e9-898bbd1522bb could not be found. {{(pid=116864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:17:24.265205 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-aabfb6e1-69f8-4b94-870d-3eacca04d974 tempest-VolumesSnapshotsTestJSON-219319307 tempest-VolumesSnapshotsTestJSON-219319307-project] 10.222.0.113 "GET /compute/v2.1/os-volumes/ef26d208-b1a3-4824-a5e9-898bbd1522bb" status: 404 len: 109 microversion: 2.1 time: 0.702878 Jan 24 09:17:24.273105 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 26/45] 10.222.0.113 () {58 vars in 1249 bytes} [Mon Jan 24 09:17:23 2022] GET /compute/v2.1/os-volumes/ef26d208-b1a3-4824-a5e9-898bbd1522bb => generated 109 bytes in 711 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 09:17:24.282024 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-4ef55a48-ac64-4d8e-a1b9-fc48e05685b3 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:24.283153 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-4ef55a48-ac64-4d8e-a1b9-fc48e05685b3 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] [instance: 8f231864-55f5-469d-b015-721a0ddc5e3d] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:24.291876 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4ef55a48-ac64-4d8e-a1b9-fc48e05685b3 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:24.292713 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4ef55a48-ac64-4d8e-a1b9-fc48e05685b3 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:24.293768 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4ef55a48-ac64-4d8e-a1b9-fc48e05685b3 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:24.294618 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4ef55a48-ac64-4d8e-a1b9-fc48e05685b3 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:24.608293 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.quota [None req-4da816a0-cbdb-4815-8470-b53f770e7900 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Getting quotas for project 94bb7ee37f9545c7a38065c3e1a3b6c1. Resources: {'key_pairs'} {{(pid=116863) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 09:17:24.627851 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.quota [None req-4da816a0-cbdb-4815-8470-b53f770e7900 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Getting quotas for user 3527d1517fb0466a8b6375e40870b474 and project 94bb7ee37f9545c7a38065c3e1a3b6c1. Resources: {'key_pairs'} {{(pid=116863) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 09:17:24.674451 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-4ef55a48-ac64-4d8e-a1b9-fc48e05685b3 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eacf11b5ea94c6386577eca24696b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cb3477628042869ffe08048f0a8ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:24.682360 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-4da816a0-cbdb-4815-8470-b53f770e7900 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 1.604985 Jan 24 09:17:24.696495 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 20/46] 10.222.0.113 () {62 vars in 1203 bytes} [Mon Jan 24 09:17:23 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 1613 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Jan 24 09:17:24.704451 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-4ef55a48-ac64-4d8e-a1b9-fc48e05685b3 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] 10.222.0.113 "GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d" status: 200 len: 1277 microversion: 2.1 time: 0.428669 Jan 24 09:17:24.706933 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 27/47] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:24 2022] GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d => generated 1277 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:24.711323 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-3cc9e354-1371-404c-be91-834a4672c318 tempest-VolumesSnapshotsTestJSON-219319307 tempest-VolumesSnapshotsTestJSON-219319307-project] Calling method '.version_select at 0x7f473e760b80>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:24.721924 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-2ce3abc0-a774-419e-a755-1cbb72f9119a tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:24.723789 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-2ce3abc0-a774-419e-a755-1cbb72f9119a tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 334e86b7-8556-46c7-aad6-e5b2af845691] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:24.732468 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2ce3abc0-a774-419e-a755-1cbb72f9119a tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:24.734393 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2ce3abc0-a774-419e-a755-1cbb72f9119a tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:24.734393 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2ce3abc0-a774-419e-a755-1cbb72f9119a tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:24.742665 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2ce3abc0-a774-419e-a755-1cbb72f9119a tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:24.835508 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.wsgi [None req-3cc9e354-1371-404c-be91-834a4672c318 tempest-VolumesSnapshotsTestJSON-219319307 tempest-VolumesSnapshotsTestJSON-219319307-project] HTTP exception thrown: Volume ef26d208-b1a3-4824-a5e9-898bbd1522bb could not be found. Jan 24 09:17:24.836119 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-3cc9e354-1371-404c-be91-834a4672c318 tempest-VolumesSnapshotsTestJSON-219319307 tempest-VolumesSnapshotsTestJSON-219319307-project] Returning 404 to user: Volume ef26d208-b1a3-4824-a5e9-898bbd1522bb could not be found. {{(pid=116863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:17:24.836959 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-3cc9e354-1371-404c-be91-834a4672c318 tempest-VolumesSnapshotsTestJSON-219319307 tempest-VolumesSnapshotsTestJSON-219319307-project] 10.222.0.113 "DELETE /compute/v2.1/os-volumes/ef26d208-b1a3-4824-a5e9-898bbd1522bb" status: 404 len: 109 microversion: 2.1 time: 0.146366 Jan 24 09:17:24.837520 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 21/48] 10.222.0.113 () {58 vars in 1252 bytes} [Mon Jan 24 09:17:24 2022] DELETE /compute/v2.1/os-volumes/ef26d208-b1a3-4824-a5e9-898bbd1522bb => generated 109 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 09:17:24.948251 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-9c9763a5-8aef-40cb-aa0a-407b69bb0004 tempest-VolumesSnapshotsTestJSON-219319307 tempest-VolumesSnapshotsTestJSON-219319307-project] Calling method '.version_select at 0x7f473e760ee0>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:25.024681 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-2ce3abc0-a774-419e-a755-1cbb72f9119a tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:25.036250 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.wsgi [None req-9c9763a5-8aef-40cb-aa0a-407b69bb0004 tempest-VolumesSnapshotsTestJSON-219319307 tempest-VolumesSnapshotsTestJSON-219319307-project] HTTP exception thrown: Volume ef26d208-b1a3-4824-a5e9-898bbd1522bb could not be found. Jan 24 09:17:25.037099 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-9c9763a5-8aef-40cb-aa0a-407b69bb0004 tempest-VolumesSnapshotsTestJSON-219319307 tempest-VolumesSnapshotsTestJSON-219319307-project] Returning 404 to user: Volume ef26d208-b1a3-4824-a5e9-898bbd1522bb could not be found. {{(pid=116863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:17:25.038715 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-9c9763a5-8aef-40cb-aa0a-407b69bb0004 tempest-VolumesSnapshotsTestJSON-219319307 tempest-VolumesSnapshotsTestJSON-219319307-project] 10.222.0.113 "GET /compute/v2.1/os-volumes/ef26d208-b1a3-4824-a5e9-898bbd1522bb" status: 404 len: 109 microversion: 2.1 time: 0.095439 Jan 24 09:17:25.040416 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-2ce3abc0-a774-419e-a755-1cbb72f9119a tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691" status: 200 len: 1280 microversion: 2.1 time: 0.330777 Jan 24 09:17:25.041885 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 28/49] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:24 2022] GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691 => generated 1280 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:25.044705 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 22/50] 10.222.0.113 () {58 vars in 1249 bytes} [Mon Jan 24 09:17:24 2022] GET /compute/v2.1/os-volumes/ef26d208-b1a3-4824-a5e9-898bbd1522bb => generated 109 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 09:17:25.529048 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-f8c2cf71-9df3-4fb7-b776-f77ef0f91f7b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-11251217", "imageRef": "c527e37f-a381-465e-babe-11528029ed9b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:17:25.729472 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-6e25a1f2-0581-47a0-a2f6-6b7f6a3afe42 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:25.729940 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-6e25a1f2-0581-47a0-a2f6-6b7f6a3afe42 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] [instance: 8f231864-55f5-469d-b015-721a0ddc5e3d] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:25.791031 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6e25a1f2-0581-47a0-a2f6-6b7f6a3afe42 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:25.801813 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6e25a1f2-0581-47a0-a2f6-6b7f6a3afe42 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:25.802871 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6e25a1f2-0581-47a0-a2f6-6b7f6a3afe42 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:25.817847 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6e25a1f2-0581-47a0-a2f6-6b7f6a3afe42 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:25.881670 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.network.neutron [None req-f8c2cf71-9df3-4fb7-b776-f77ef0f91f7b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] validate_networks() for [('f851d587-14cc-48ac-9b32-b0aa546a9c65', None, None, None, None, None)] {{(pid=116864) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 09:17:26.295914 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-6e25a1f2-0581-47a0-a2f6-6b7f6a3afe42 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eacf11b5ea94c6386577eca24696b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cb3477628042869ffe08048f0a8ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:26.319004 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-6e25a1f2-0581-47a0-a2f6-6b7f6a3afe42 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] 10.222.0.113 "GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d" status: 200 len: 1277 microversion: 2.1 time: 0.594300 Jan 24 09:17:26.320954 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 23/51] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:25 2022] GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d => generated 1277 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:26.335806 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-105c93a1-0041-44a9-8529-a225b2e3b4a5 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:26.340720 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-105c93a1-0041-44a9-8529-a225b2e3b4a5 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 334e86b7-8556-46c7-aad6-e5b2af845691] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:26.344098 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-105c93a1-0041-44a9-8529-a225b2e3b4a5 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:26.344878 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-105c93a1-0041-44a9-8529-a225b2e3b4a5 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:26.346332 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-105c93a1-0041-44a9-8529-a225b2e3b4a5 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:26.347018 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-105c93a1-0041-44a9-8529-a225b2e3b4a5 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:26.981729 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-105c93a1-0041-44a9-8529-a225b2e3b4a5 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:26.981729 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-105c93a1-0041-44a9-8529-a225b2e3b4a5 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691" status: 200 len: 1322 microversion: 2.1 time: 0.565004 Jan 24 09:17:26.981729 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 24/52] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:26 2022] GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691 => generated 1322 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:27.337117 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-b813ffac-de2c-4d27-8809-ad05e17e7b95 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:27.338013 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-b813ffac-de2c-4d27-8809-ad05e17e7b95 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] [instance: 8f231864-55f5-469d-b015-721a0ddc5e3d] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:27.352874 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b813ffac-de2c-4d27-8809-ad05e17e7b95 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:27.358894 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b813ffac-de2c-4d27-8809-ad05e17e7b95 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:27.360008 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b813ffac-de2c-4d27-8809-ad05e17e7b95 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:27.360596 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b813ffac-de2c-4d27-8809-ad05e17e7b95 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:27.752459 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-f8c2cf71-9df3-4fb7-b776-f77ef0f91f7b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Flavor limits 0:0:0 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 09:17:27.756609 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-f8c2cf71-9df3-4fb7-b776-f77ef0f91f7b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Image limits 0:0:0 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 09:17:27.756609 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-f8c2cf71-9df3-4fb7-b776-f77ef0f91f7b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Flavor pref 0:0:0 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 09:17:27.756609 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-f8c2cf71-9df3-4fb7-b776-f77ef0f91f7b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Image pref 0:0:0 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 09:17:27.757798 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-f8c2cf71-9df3-4fb7-b776-f77ef0f91f7b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 09:17:28.016784 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f8c2cf71-9df3-4fb7-b776-f77ef0f91f7b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:28.016784 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f8c2cf71-9df3-4fb7-b776-f77ef0f91f7b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:28.016784 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f8c2cf71-9df3-4fb7-b776-f77ef0f91f7b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:28.016784 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f8c2cf71-9df3-4fb7-b776-f77ef0f91f7b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:28.017948 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.quota [None req-f8c2cf71-9df3-4fb7-b776-f77ef0f91f7b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Getting quotas for project cd6f638b201f414f81bda294a0adce5b. Resources: {'ram', 'cores', 'instances'} {{(pid=116864) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 09:17:28.017948 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.quota [None req-f8c2cf71-9df3-4fb7-b776-f77ef0f91f7b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Getting quotas for user 354fc57e1b9d49e3ba9102bfe5d76980 and project cd6f638b201f414f81bda294a0adce5b. Resources: {'ram', 'cores', 'instances'} {{(pid=116864) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 09:17:28.017948 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-f8c2cf71-9df3-4fb7-b776-f77ef0f91f7b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Going to run 1 instances... {{(pid=116864) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 09:17:28.018252 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-f8c2cf71-9df3-4fb7-b776-f77ef0f91f7b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c527e37f-a381-465e-babe-11528029ed9b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 09:17:28.327257 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-f8c2cf71-9df3-4fb7-b776-f77ef0f91f7b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 3.237272 Jan 24 09:17:28.344789 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 29/53] 10.222.0.113 () {60 vars in 1151 bytes} [Mon Jan 24 09:17:25 2022] POST /compute/v2.1/servers => generated 385 bytes in 3257 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 24 09:17:28.352685 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-424a1975-4957-4f59-8368-2cd4be33d635 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:28.381749 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-424a1975-4957-4f59-8368-2cd4be33d635 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 334e86b7-8556-46c7-aad6-e5b2af845691] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:28.398757 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-424a1975-4957-4f59-8368-2cd4be33d635 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:28.399460 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-424a1975-4957-4f59-8368-2cd4be33d635 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:28.409690 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-424a1975-4957-4f59-8368-2cd4be33d635 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:28.410481 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-424a1975-4957-4f59-8368-2cd4be33d635 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:28.982449 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-b813ffac-de2c-4d27-8809-ad05e17e7b95 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eacf11b5ea94c6386577eca24696b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cb3477628042869ffe08048f0a8ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:29.001913 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-b813ffac-de2c-4d27-8809-ad05e17e7b95 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] 10.222.0.113 "GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d" status: 200 len: 1319 microversion: 2.1 time: 1.663736 Jan 24 09:17:29.017185 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 25/54] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:27 2022] GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d => generated 1319 bytes in 1685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:17:29.022784 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-0a5ff199-da0e-4b4b-b329-986a636b4821 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:29.037893 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-0a5ff199-da0e-4b4b-b329-986a636b4821 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:29.643888 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-424a1975-4957-4f59-8368-2cd4be33d635 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:29.643888 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-424a1975-4957-4f59-8368-2cd4be33d635 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691" status: 200 len: 1322 microversion: 2.1 time: 1.282268 Jan 24 09:17:29.647889 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-0a5ff199-da0e-4b4b-b329-986a636b4821 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:29.649647 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 30/55] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:28 2022] GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691 => generated 1322 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:29.650610 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-0a5ff199-da0e-4b4b-b329-986a636b4821 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1224 microversion: 2.1 time: 0.618891 Jan 24 09:17:29.650610 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 26/56] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:29 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1224 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:30.020625 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-aa0bbfd2-dc76-4d51-87e1-9c7675aefced tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:30.025442 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-aa0bbfd2-dc76-4d51-87e1-9c7675aefced tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] [instance: 8f231864-55f5-469d-b015-721a0ddc5e3d] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:30.048273 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-aa0bbfd2-dc76-4d51-87e1-9c7675aefced tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:30.049053 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-aa0bbfd2-dc76-4d51-87e1-9c7675aefced tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:30.052236 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-aa0bbfd2-dc76-4d51-87e1-9c7675aefced tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:30.053193 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-aa0bbfd2-dc76-4d51-87e1-9c7675aefced tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:30.315382 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-d6d98780-1845-46bf-b8ae-181f8140866b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-305582957", "imageRef": "c527e37f-a381-465e-babe-11528029ed9b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:17:30.436894 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.network.neutron [None req-d6d98780-1845-46bf-b8ae-181f8140866b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] validate_networks() for [('f851d587-14cc-48ac-9b32-b0aa546a9c65', None, None, None, None, None)] {{(pid=116863) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 09:17:31.340872 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-aa0bbfd2-dc76-4d51-87e1-9c7675aefced tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eacf11b5ea94c6386577eca24696b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cb3477628042869ffe08048f0a8ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:31.355861 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-aa0bbfd2-dc76-4d51-87e1-9c7675aefced tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] 10.222.0.113 "GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d" status: 200 len: 1319 microversion: 2.1 time: 1.340199 Jan 24 09:17:31.356452 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 31/57] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:30 2022] GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d => generated 1319 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:31.763435 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-ea313894-87fe-43b5-879a-1585fa4922e8 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'create', calling method: .version_select at 0x7f473ef72ca0>, body: {"keypair": {"name": "tempest-keypair-2074494851"}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:17:31.842735 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.quota [None req-ea313894-87fe-43b5-879a-1585fa4922e8 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Getting quotas for project 1dc910091533410a986175bf4570f541. Resources: {'key_pairs'} {{(pid=116864) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 09:17:31.872632 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.quota [None req-ea313894-87fe-43b5-879a-1585fa4922e8 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Getting quotas for user 1474c62f3a5d4363ba48daf145765db6 and project 1dc910091533410a986175bf4570f541. Resources: {'key_pairs'} {{(pid=116864) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 09:17:32.032030 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.virt.hardware [None req-d6d98780-1845-46bf-b8ae-181f8140866b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Flavor limits 0:0:0 {{(pid=116863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 09:17:32.032592 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.virt.hardware [None req-d6d98780-1845-46bf-b8ae-181f8140866b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Image limits 0:0:0 {{(pid=116863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 09:17:32.033031 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.virt.hardware [None req-d6d98780-1845-46bf-b8ae-181f8140866b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Flavor pref 0:0:0 {{(pid=116863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 09:17:32.033318 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.virt.hardware [None req-d6d98780-1845-46bf-b8ae-181f8140866b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Image pref 0:0:0 {{(pid=116863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 09:17:32.033741 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.virt.hardware [None req-d6d98780-1845-46bf-b8ae-181f8140866b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 09:17:32.060464 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d6d98780-1845-46bf-b8ae-181f8140866b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:32.069854 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d6d98780-1845-46bf-b8ae-181f8140866b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:32.075488 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d6d98780-1845-46bf-b8ae-181f8140866b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:32.076084 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d6d98780-1845-46bf-b8ae-181f8140866b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:32.145455 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.quota [None req-d6d98780-1845-46bf-b8ae-181f8140866b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Getting quotas for project cd6f638b201f414f81bda294a0adce5b. Resources: {'ram', 'cores', 'instances'} {{(pid=116863) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 09:17:32.159617 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.quota [None req-d6d98780-1845-46bf-b8ae-181f8140866b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Getting quotas for user 354fc57e1b9d49e3ba9102bfe5d76980 and project cd6f638b201f414f81bda294a0adce5b. Resources: {'ram', 'cores', 'instances'} {{(pid=116863) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 09:17:32.199726 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-d6d98780-1845-46bf-b8ae-181f8140866b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Going to run 1 instances... {{(pid=116863) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 09:17:32.205557 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-d6d98780-1845-46bf-b8ae-181f8140866b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c527e37f-a381-465e-babe-11528029ed9b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 09:17:32.432232 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-d6d98780-1845-46bf-b8ae-181f8140866b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 2.118486 Jan 24 09:17:32.434656 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 27/58] 10.222.0.113 () {60 vars in 1151 bytes} [Mon Jan 24 09:17:30 2022] POST /compute/v2.1/servers => generated 385 bytes in 2125 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 24 09:17:32.459227 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-0fc9e59e-6e81-4b04-b130-5fe6e5604273 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:32.462204 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-0fc9e59e-6e81-4b04-b130-5fe6e5604273 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 334e86b7-8556-46c7-aad6-e5b2af845691] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:32.491478 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0fc9e59e-6e81-4b04-b130-5fe6e5604273 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:32.494313 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0fc9e59e-6e81-4b04-b130-5fe6e5604273 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:32.498829 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0fc9e59e-6e81-4b04-b130-5fe6e5604273 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:32.500716 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0fc9e59e-6e81-4b04-b130-5fe6e5604273 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:32.660314 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.quota [None req-ea313894-87fe-43b5-879a-1585fa4922e8 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Getting quotas for project 1dc910091533410a986175bf4570f541. Resources: {'key_pairs'} {{(pid=116864) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 09:17:32.676303 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.quota [None req-ea313894-87fe-43b5-879a-1585fa4922e8 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Getting quotas for user 1474c62f3a5d4363ba48daf145765db6 and project 1dc910091533410a986175bf4570f541. Resources: {'key_pairs'} {{(pid=116864) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 09:17:32.736991 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-ea313894-87fe-43b5-879a-1585fa4922e8 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 1.370765 Jan 24 09:17:32.740059 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 32/59] 10.222.0.113 () {60 vars in 1162 bytes} [Mon Jan 24 09:17:31 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:33.333026 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [req-334ff71a-8ac0-44cf-b4db-9728e90913ca req-873499bb-52e6-4e26-97d2-cf83f4ffef15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "334e86b7-8556-46c7-aad6-e5b2af845691", "tag": "9d784b74-8dec-426c-928f-bed55e1f51fe"}]} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:17:33.336463 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:17:33.336463 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: warnings.warn(msg) Jan 24 09:17:33.382030 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-334ff71a-8ac0-44cf-b4db-9728e90913ca req-873499bb-52e6-4e26-97d2-cf83f4ffef15 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:33.385047 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-334ff71a-8ac0-44cf-b4db-9728e90913ca req-873499bb-52e6-4e26-97d2-cf83f4ffef15 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:33.485804 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.compute.server_external_events [req-334ff71a-8ac0-44cf-b4db-9728e90913ca req-873499bb-52e6-4e26-97d2-cf83f4ffef15 service nova] Creating event network-changed:9d784b74-8dec-426c-928f-bed55e1f51fe for instance 334e86b7-8556-46c7-aad6-e5b2af845691 on hv-cinder-80403 Jan 24 09:17:33.491090 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-334ff71a-8ac0-44cf-b4db-9728e90913ca req-873499bb-52e6-4e26-97d2-cf83f4ffef15 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116864) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 24 09:17:33.493239 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-9887dbda-a86d-42d5-b18f-d03ab5667869 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:33.500677 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-9887dbda-a86d-42d5-b18f-d03ab5667869 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:33.500677 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-9887dbda-a86d-42d5-b18f-d03ab5667869 None None] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:33.500677 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-9887dbda-a86d-42d5-b18f-d03ab5667869 None None] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:33.525937 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.compute.rpcapi [None req-9887dbda-a86d-42d5-b18f-d03ab5667869 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 24 09:17:33.529405 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-9887dbda-a86d-42d5-b18f-d03ab5667869 None None] Releasing lock "compute-rpcapi-router" {{(pid=116864) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 24 09:17:33.579627 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-9887dbda-a86d-42d5-b18f-d03ab5667869 None None] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.830595 Jan 24 09:17:33.586687 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 33/60] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:17:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:17:33.589892 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-c5606e3b-7692-4f32-93be-67ca6412d5a1 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:33.616914 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-c5606e3b-7692-4f32-93be-67ca6412d5a1 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] [instance: 8f231864-55f5-469d-b015-721a0ddc5e3d] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:33.633781 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c5606e3b-7692-4f32-93be-67ca6412d5a1 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:33.642913 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c5606e3b-7692-4f32-93be-67ca6412d5a1 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:33.647794 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c5606e3b-7692-4f32-93be-67ca6412d5a1 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:33.648747 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c5606e3b-7692-4f32-93be-67ca6412d5a1 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:35.092545 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-0fc9e59e-6e81-4b04-b130-5fe6e5604273 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:35.123741 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-0fc9e59e-6e81-4b04-b130-5fe6e5604273 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691" status: 200 len: 1322 microversion: 2.1 time: 2.685795 Jan 24 09:17:35.127779 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 28/61] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:32 2022] GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691 => generated 1322 bytes in 2691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:35.155043 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-d0526b5b-bbd5-45d2-9d31-a32c1668b892 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:35.169017 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-d0526b5b-bbd5-45d2-9d31-a32c1668b892 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:35.194465 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d0526b5b-bbd5-45d2-9d31-a32c1668b892 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:35.195535 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d0526b5b-bbd5-45d2-9d31-a32c1668b892 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:35.206122 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d0526b5b-bbd5-45d2-9d31-a32c1668b892 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:35.206122 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d0526b5b-bbd5-45d2-9d31-a32c1668b892 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:35.428067 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-c5606e3b-7692-4f32-93be-67ca6412d5a1 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eacf11b5ea94c6386577eca24696b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cb3477628042869ffe08048f0a8ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:35.438565 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-c5606e3b-7692-4f32-93be-67ca6412d5a1 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] 10.222.0.113 "GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d" status: 200 len: 1319 microversion: 2.1 time: 1.857046 Jan 24 09:17:35.451425 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 34/62] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:33 2022] GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d => generated 1319 bytes in 1870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:35.670269 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-d0526b5b-bbd5-45d2-9d31-a32c1668b892 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:35.681249 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-d0526b5b-bbd5-45d2-9d31-a32c1668b892 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1277 microversion: 2.1 time: 0.542339 Jan 24 09:17:35.696802 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 29/63] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:35 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1277 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:36.143561 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-b7e85935-eacc-4b46-8883-36ff9840130e tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:36.145366 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-b7e85935-eacc-4b46-8883-36ff9840130e tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 334e86b7-8556-46c7-aad6-e5b2af845691] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:36.157418 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b7e85935-eacc-4b46-8883-36ff9840130e tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:36.158286 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b7e85935-eacc-4b46-8883-36ff9840130e tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:36.159350 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b7e85935-eacc-4b46-8883-36ff9840130e tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:36.160571 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b7e85935-eacc-4b46-8883-36ff9840130e tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:36.335181 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [req-cf3728dd-5bea-4798-b1e1-d19e3c65b466 req-f1171431-f149-405e-b924-d546d3b9a1f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f231864-55f5-469d-b015-721a0ddc5e3d", "tag": "af0ff79f-46d7-41b6-adb2-1f564fafaaba"}]} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:17:36.337405 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:17:36.337405 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: warnings.warn(msg) Jan 24 09:17:36.369877 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-cf3728dd-5bea-4798-b1e1-d19e3c65b466 req-f1171431-f149-405e-b924-d546d3b9a1f7 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:36.381205 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-cf3728dd-5bea-4798-b1e1-d19e3c65b466 req-f1171431-f149-405e-b924-d546d3b9a1f7 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:36.429229 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.compute.server_external_events [req-cf3728dd-5bea-4798-b1e1-d19e3c65b466 req-f1171431-f149-405e-b924-d546d3b9a1f7 service nova] Creating event network-changed:af0ff79f-46d7-41b6-adb2-1f564fafaaba for instance 8f231864-55f5-469d-b015-721a0ddc5e3d on hv-cinder-80403 Jan 24 09:17:36.462311 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [req-cf3728dd-5bea-4798-b1e1-d19e3c65b466 req-f1171431-f149-405e-b924-d546d3b9a1f7 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.002696 Jan 24 09:17:36.463138 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 35/64] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:17:36.493807 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-b234e206-6f2b-415d-8451-b7e11cc0a9fd tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:36.512684 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-b234e206-6f2b-415d-8451-b7e11cc0a9fd tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] [instance: 8f231864-55f5-469d-b015-721a0ddc5e3d] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:36.552150 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b234e206-6f2b-415d-8451-b7e11cc0a9fd tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:36.555032 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b234e206-6f2b-415d-8451-b7e11cc0a9fd tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:36.558695 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b234e206-6f2b-415d-8451-b7e11cc0a9fd tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:36.561017 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b234e206-6f2b-415d-8451-b7e11cc0a9fd tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:37.031946 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-b7e85935-eacc-4b46-8883-36ff9840130e tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:37.044563 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-b7e85935-eacc-4b46-8883-36ff9840130e tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691" status: 200 len: 1322 microversion: 2.1 time: 0.904583 Jan 24 09:17:37.055081 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 30/65] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:36 2022] GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691 => generated 1322 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:17:37.056471 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-7edb4bf4-469f-4913-b13a-912bfd9a9859 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:37.057353 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-7edb4bf4-469f-4913-b13a-912bfd9a9859 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:37.075363 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7edb4bf4-469f-4913-b13a-912bfd9a9859 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:37.075820 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7edb4bf4-469f-4913-b13a-912bfd9a9859 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:37.076628 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7edb4bf4-469f-4913-b13a-912bfd9a9859 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:37.077064 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7edb4bf4-469f-4913-b13a-912bfd9a9859 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:37.408138 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-b234e206-6f2b-415d-8451-b7e11cc0a9fd tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eacf11b5ea94c6386577eca24696b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cb3477628042869ffe08048f0a8ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:37.430437 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-b234e206-6f2b-415d-8451-b7e11cc0a9fd tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] 10.222.0.113 "GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d" status: 200 len: 1319 microversion: 2.1 time: 0.957915 Jan 24 09:17:37.439584 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 36/66] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:36 2022] GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d => generated 1319 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:37.446267 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-bf2a1d23-6ce9-46be-8d9f-2eef14025f37 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1308704902", "imageRef": "c527e37f-a381-465e-babe-11528029ed9b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b0d83e5f-030e-4cd8-ac08-bbed93fad267"}], "security_groups": [{"name": "tempest-securitygroup--1990737370"}], "key_name": "tempest-keypair-437373915", "user_data": "}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:17:37.604852 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.network.neutron [None req-bf2a1d23-6ce9-46be-8d9f-2eef14025f37 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] validate_networks() for [('b0d83e5f-030e-4cd8-ac08-bbed93fad267', None, None, None, None, None)] {{(pid=116864) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 09:17:37.666660 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-7edb4bf4-469f-4913-b13a-912bfd9a9859 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:37.687318 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-7edb4bf4-469f-4913-b13a-912bfd9a9859 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1283 microversion: 2.1 time: 0.631620 Jan 24 09:17:37.690451 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 31/67] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:37 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1283 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:38.063001 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-b85265f7-c74d-473a-b55b-9c273300caac tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:38.063683 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-b85265f7-c74d-473a-b55b-9c273300caac tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 334e86b7-8556-46c7-aad6-e5b2af845691] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:38.091306 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b85265f7-c74d-473a-b55b-9c273300caac tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:38.091969 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b85265f7-c74d-473a-b55b-9c273300caac tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:38.099698 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b85265f7-c74d-473a-b55b-9c273300caac tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:38.102184 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b85265f7-c74d-473a-b55b-9c273300caac tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:38.485397 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-bf2a1d23-6ce9-46be-8d9f-2eef14025f37 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Flavor limits 0:0:0 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 09:17:38.486088 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-bf2a1d23-6ce9-46be-8d9f-2eef14025f37 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Image limits 0:0:0 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 09:17:38.487092 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-bf2a1d23-6ce9-46be-8d9f-2eef14025f37 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Flavor pref 0:0:0 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 09:17:38.487758 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-bf2a1d23-6ce9-46be-8d9f-2eef14025f37 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Image pref 0:0:0 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 09:17:38.488313 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-bf2a1d23-6ce9-46be-8d9f-2eef14025f37 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 09:17:38.502342 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-bf2a1d23-6ce9-46be-8d9f-2eef14025f37 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:38.503174 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-bf2a1d23-6ce9-46be-8d9f-2eef14025f37 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:38.506714 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-bf2a1d23-6ce9-46be-8d9f-2eef14025f37 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:38.506714 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-bf2a1d23-6ce9-46be-8d9f-2eef14025f37 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:38.531894 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.quota [None req-bf2a1d23-6ce9-46be-8d9f-2eef14025f37 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Getting quotas for project 94bb7ee37f9545c7a38065c3e1a3b6c1. Resources: {'ram', 'cores', 'instances'} {{(pid=116864) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 09:17:38.538835 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.quota [None req-bf2a1d23-6ce9-46be-8d9f-2eef14025f37 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Getting quotas for user 3527d1517fb0466a8b6375e40870b474 and project 94bb7ee37f9545c7a38065c3e1a3b6c1. Resources: {'ram', 'cores', 'instances'} {{(pid=116864) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 09:17:38.553024 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-bf2a1d23-6ce9-46be-8d9f-2eef14025f37 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Going to run 1 instances... {{(pid=116864) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 09:17:38.556129 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-bf2a1d23-6ce9-46be-8d9f-2eef14025f37 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c527e37f-a381-465e-babe-11528029ed9b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 09:17:38.761932 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-bf2a1d23-6ce9-46be-8d9f-2eef14025f37 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.20 time: 1.320708 Jan 24 09:17:38.771127 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 37/68] 10.222.0.113 () {62 vars in 1192 bytes} [Mon Jan 24 09:17:37 2022] POST /compute/v2.1/servers => generated 404 bytes in 1330 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jan 24 09:17:38.820555 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-1d5fff7e-6bfc-4d58-8fda-4c7bb41a2cdd tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:38.821295 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-1d5fff7e-6bfc-4d58-8fda-4c7bb41a2cdd tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] [instance: 8f231864-55f5-469d-b015-721a0ddc5e3d] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:38.838327 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1d5fff7e-6bfc-4d58-8fda-4c7bb41a2cdd tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:38.839073 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1d5fff7e-6bfc-4d58-8fda-4c7bb41a2cdd tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:38.840708 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1d5fff7e-6bfc-4d58-8fda-4c7bb41a2cdd tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:38.841306 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1d5fff7e-6bfc-4d58-8fda-4c7bb41a2cdd tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:39.244159 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-b85265f7-c74d-473a-b55b-9c273300caac tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:39.246307 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-1d5fff7e-6bfc-4d58-8fda-4c7bb41a2cdd tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eacf11b5ea94c6386577eca24696b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cb3477628042869ffe08048f0a8ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:39.251582 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-b85265f7-c74d-473a-b55b-9c273300caac tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691" status: 200 len: 1322 microversion: 2.1 time: 1.192361 Jan 24 09:17:39.252396 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 32/69] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:38 2022] GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691 => generated 1322 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:39.256161 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-1d5fff7e-6bfc-4d58-8fda-4c7bb41a2cdd tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] 10.222.0.113 "GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d" status: 200 len: 1319 microversion: 2.1 time: 0.482716 Jan 24 09:17:39.266246 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-a5691350-7cb4-4b75-b739-e454e34cc4fa tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:39.266246 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-a5691350-7cb4-4b75-b739-e454e34cc4fa tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:39.267214 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 38/70] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:38 2022] GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d => generated 1319 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:39.273591 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-28dbfa64-ae64-45e6-9bca-aac41478e405 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:39.274462 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-28dbfa64-ae64-45e6-9bca-aac41478e405 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:39.278057 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a5691350-7cb4-4b75-b739-e454e34cc4fa tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:39.278737 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a5691350-7cb4-4b75-b739-e454e34cc4fa tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:39.279312 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a5691350-7cb4-4b75-b739-e454e34cc4fa tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:39.279746 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a5691350-7cb4-4b75-b739-e454e34cc4fa tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:39.382833 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-28dbfa64-ae64-45e6-9bca-aac41478e405 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:39.396306 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-28dbfa64-ae64-45e6-9bca-aac41478e405 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:39.398980 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-28dbfa64-ae64-45e6-9bca-aac41478e405 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:39.400816 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-28dbfa64-ae64-45e6-9bca-aac41478e405 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1285 microversion: 2.20 time: 0.132298 Jan 24 09:17:39.401481 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 39/71] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:17:39 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1285 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:17:39.413770 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-a5691350-7cb4-4b75-b739-e454e34cc4fa tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:39.422088 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-a5691350-7cb4-4b75-b739-e454e34cc4fa tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1283 microversion: 2.1 time: 0.168074 Jan 24 09:17:39.424427 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 33/72] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:39 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1283 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:40.272546 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-d88dfa08-9a8d-41cf-8a2f-2a540418603c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:40.273425 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-d88dfa08-9a8d-41cf-8a2f-2a540418603c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 334e86b7-8556-46c7-aad6-e5b2af845691] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:40.274644 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-829427ea-f612-45e9-b9f3-133023c07db4 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:40.275630 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-829427ea-f612-45e9-b9f3-133023c07db4 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] [instance: 8f231864-55f5-469d-b015-721a0ddc5e3d] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:40.282845 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d88dfa08-9a8d-41cf-8a2f-2a540418603c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:40.283591 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d88dfa08-9a8d-41cf-8a2f-2a540418603c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:40.284111 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-829427ea-f612-45e9-b9f3-133023c07db4 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:40.285098 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-829427ea-f612-45e9-b9f3-133023c07db4 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:40.285634 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d88dfa08-9a8d-41cf-8a2f-2a540418603c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:40.286195 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d88dfa08-9a8d-41cf-8a2f-2a540418603c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:40.287154 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-829427ea-f612-45e9-b9f3-133023c07db4 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:40.288164 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-829427ea-f612-45e9-b9f3-133023c07db4 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:40.447473 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-d88dfa08-9a8d-41cf-8a2f-2a540418603c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:40.473170 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-d88dfa08-9a8d-41cf-8a2f-2a540418603c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691" status: 200 len: 1322 microversion: 2.1 time: 0.203361 Jan 24 09:17:40.474882 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 40/73] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:40 2022] GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691 => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:40.482329 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-9b798e19-9204-41ef-ba45-bf239bad31f7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:40.482506 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-9b798e19-9204-41ef-ba45-bf239bad31f7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:40.492060 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-9b798e19-9204-41ef-ba45-bf239bad31f7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:40.492780 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-9b798e19-9204-41ef-ba45-bf239bad31f7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:40.494090 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-9b798e19-9204-41ef-ba45-bf239bad31f7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:40.494790 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-9b798e19-9204-41ef-ba45-bf239bad31f7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:40.541216 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-829427ea-f612-45e9-b9f3-133023c07db4 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eacf11b5ea94c6386577eca24696b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cb3477628042869ffe08048f0a8ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:40.569406 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-829427ea-f612-45e9-b9f3-133023c07db4 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] 10.222.0.113 "GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d" status: 200 len: 1319 microversion: 2.1 time: 0.300060 Jan 24 09:17:40.573598 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 34/74] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:40 2022] GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d => generated 1319 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:17:40.578369 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-391c3c3f-c23b-4a17-8893-a0139915d363 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:40.578991 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-391c3c3f-c23b-4a17-8893-a0139915d363 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:40.598023 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-391c3c3f-c23b-4a17-8893-a0139915d363 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:40.599484 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-391c3c3f-c23b-4a17-8893-a0139915d363 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:40.599484 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-391c3c3f-c23b-4a17-8893-a0139915d363 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:40.600484 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-391c3c3f-c23b-4a17-8893-a0139915d363 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:40.608619 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-9b798e19-9204-41ef-ba45-bf239bad31f7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:40.619157 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-9b798e19-9204-41ef-ba45-bf239bad31f7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:40.620758 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-9b798e19-9204-41ef-ba45-bf239bad31f7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:40.621908 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-9b798e19-9204-41ef-ba45-bf239bad31f7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1289 microversion: 2.20 time: 0.145618 Jan 24 09:17:40.622535 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 41/75] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:17:40 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1289 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:17:40.680079 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-d6fc23f3-4e4a-4ba5-b75c-176f862328a9 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-572115407", "imageRef": "c527e37f-a381-465e-babe-11528029ed9b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cecc965a-bd5f-433d-822a-db760db2c0ab"}], "security_groups": [{"name": "tempest-securitygroup--760775286"}], "key_name": "tempest-keypair-2074494851", "user_data": "}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:17:40.763306 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-391c3c3f-c23b-4a17-8893-a0139915d363 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:40.774427 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-391c3c3f-c23b-4a17-8893-a0139915d363 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1325 microversion: 2.1 time: 0.199409 Jan 24 09:17:40.775320 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 35/76] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:40 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1325 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:40.821431 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.network.neutron [None req-d6fc23f3-4e4a-4ba5-b75c-176f862328a9 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] validate_networks() for [('cecc965a-bd5f-433d-822a-db760db2c0ab', None, None, None, None, None)] {{(pid=116864) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 09:17:41.236891 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-d6fc23f3-4e4a-4ba5-b75c-176f862328a9 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Flavor limits 0:0:0 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 09:17:41.237321 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-d6fc23f3-4e4a-4ba5-b75c-176f862328a9 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Image limits 0:0:0 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 09:17:41.237864 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-d6fc23f3-4e4a-4ba5-b75c-176f862328a9 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Flavor pref 0:0:0 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 09:17:41.238318 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-d6fc23f3-4e4a-4ba5-b75c-176f862328a9 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Image pref 0:0:0 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 09:17:41.238767 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-d6fc23f3-4e4a-4ba5-b75c-176f862328a9 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 09:17:41.247465 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d6fc23f3-4e4a-4ba5-b75c-176f862328a9 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:41.251119 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d6fc23f3-4e4a-4ba5-b75c-176f862328a9 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:41.251119 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d6fc23f3-4e4a-4ba5-b75c-176f862328a9 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:41.251119 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d6fc23f3-4e4a-4ba5-b75c-176f862328a9 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:41.279082 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.quota [None req-d6fc23f3-4e4a-4ba5-b75c-176f862328a9 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Getting quotas for project 1dc910091533410a986175bf4570f541. Resources: {'ram', 'cores', 'instances'} {{(pid=116864) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 09:17:41.287791 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.quota [None req-d6fc23f3-4e4a-4ba5-b75c-176f862328a9 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Getting quotas for user 1474c62f3a5d4363ba48daf145765db6 and project 1dc910091533410a986175bf4570f541. Resources: {'ram', 'cores', 'instances'} {{(pid=116864) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 09:17:41.305996 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-d6fc23f3-4e4a-4ba5-b75c-176f862328a9 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Going to run 1 instances... {{(pid=116864) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 09:17:41.308555 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-d6fc23f3-4e4a-4ba5-b75c-176f862328a9 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c527e37f-a381-465e-babe-11528029ed9b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 09:17:41.420630 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-d6fc23f3-4e4a-4ba5-b75c-176f862328a9 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.746127 Jan 24 09:17:41.421278 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 42/77] 10.222.0.113 () {60 vars in 1151 bytes} [Mon Jan 24 09:17:40 2022] POST /compute/v2.1/servers => generated 403 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jan 24 09:17:41.431237 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-410352dc-223d-44a3-9730-3e4ee3721db3 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:41.432119 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-410352dc-223d-44a3-9730-3e4ee3721db3 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:41.499858 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-ba23b59a-e06a-4711-83ae-4a94c5cfcc33 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:41.500473 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-ba23b59a-e06a-4711-83ae-4a94c5cfcc33 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 334e86b7-8556-46c7-aad6-e5b2af845691] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:41.511827 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ba23b59a-e06a-4711-83ae-4a94c5cfcc33 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:41.512278 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ba23b59a-e06a-4711-83ae-4a94c5cfcc33 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:41.513068 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ba23b59a-e06a-4711-83ae-4a94c5cfcc33 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:41.513501 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ba23b59a-e06a-4711-83ae-4a94c5cfcc33 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:41.525281 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-410352dc-223d-44a3-9730-3e4ee3721db3 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:41.537746 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-410352dc-223d-44a3-9730-3e4ee3721db3 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1241 microversion: 2.1 time: 0.108939 Jan 24 09:17:41.550047 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 36/78] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:41 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1241 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:41.592399 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-c27017f7-4388-427c-8d9e-8225d3c759a5 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:41.593180 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-c27017f7-4388-427c-8d9e-8225d3c759a5 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] [instance: 8f231864-55f5-469d-b015-721a0ddc5e3d] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:41.611171 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c27017f7-4388-427c-8d9e-8225d3c759a5 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:41.615527 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c27017f7-4388-427c-8d9e-8225d3c759a5 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:41.617351 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c27017f7-4388-427c-8d9e-8225d3c759a5 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:41.617934 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c27017f7-4388-427c-8d9e-8225d3c759a5 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:41.789639 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-ba23b59a-e06a-4711-83ae-4a94c5cfcc33 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:41.800070 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-ba23b59a-e06a-4711-83ae-4a94c5cfcc33 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691" status: 200 len: 1322 microversion: 2.1 time: 0.302007 Jan 24 09:17:41.800070 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 43/79] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:41 2022] GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691 => generated 1322 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:17:41.806017 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-cccd98db-d26c-455e-801a-0f60d6f8b0f4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:41.806943 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-cccd98db-d26c-455e-801a-0f60d6f8b0f4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:41.824981 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-cccd98db-d26c-455e-801a-0f60d6f8b0f4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:41.825725 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-cccd98db-d26c-455e-801a-0f60d6f8b0f4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:41.827028 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-cccd98db-d26c-455e-801a-0f60d6f8b0f4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:41.827601 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-cccd98db-d26c-455e-801a-0f60d6f8b0f4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:41.883710 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-c27017f7-4388-427c-8d9e-8225d3c759a5 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eacf11b5ea94c6386577eca24696b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cb3477628042869ffe08048f0a8ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:41.891282 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-c27017f7-4388-427c-8d9e-8225d3c759a5 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] 10.222.0.113 "GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d" status: 200 len: 1319 microversion: 2.1 time: 0.307771 Jan 24 09:17:41.892035 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 37/80] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:41 2022] GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d => generated 1319 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:41.899551 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-599f7ea7-5293-4a32-8d1b-5381578ea51d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:41.900432 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-599f7ea7-5293-4a32-8d1b-5381578ea51d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:41.906545 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-599f7ea7-5293-4a32-8d1b-5381578ea51d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:41.907239 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-599f7ea7-5293-4a32-8d1b-5381578ea51d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:41.908024 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-599f7ea7-5293-4a32-8d1b-5381578ea51d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:41.908461 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-599f7ea7-5293-4a32-8d1b-5381578ea51d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:41.929770 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-cccd98db-d26c-455e-801a-0f60d6f8b0f4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:41.937990 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-cccd98db-d26c-455e-801a-0f60d6f8b0f4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:41.939868 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-cccd98db-d26c-455e-801a-0f60d6f8b0f4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:41.941905 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-cccd98db-d26c-455e-801a-0f60d6f8b0f4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1289 microversion: 2.20 time: 0.139493 Jan 24 09:17:41.943255 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 44/81] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:17:41 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1289 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:17:42.365186 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-599f7ea7-5293-4a32-8d1b-5381578ea51d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:42.375150 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-599f7ea7-5293-4a32-8d1b-5381578ea51d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1325 microversion: 2.1 time: 0.480796 Jan 24 09:17:42.375783 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 38/82] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:41 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1325 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:42.557842 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-afabdd8c-9923-49a9-8107-3b97566caba3 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:42.561104 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-afabdd8c-9923-49a9-8107-3b97566caba3 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:42.632371 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-afabdd8c-9923-49a9-8107-3b97566caba3 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:42.644331 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-afabdd8c-9923-49a9-8107-3b97566caba3 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1241 microversion: 2.1 time: 0.090379 Jan 24 09:17:42.645653 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 45/83] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:42 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1241 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:42.817053 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-8bc375d9-f789-4394-a330-49491911982d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:42.817661 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-8bc375d9-f789-4394-a330-49491911982d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 334e86b7-8556-46c7-aad6-e5b2af845691] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:42.824716 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8bc375d9-f789-4394-a330-49491911982d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:42.825096 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8bc375d9-f789-4394-a330-49491911982d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:42.825871 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8bc375d9-f789-4394-a330-49491911982d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:42.826463 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8bc375d9-f789-4394-a330-49491911982d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:42.908584 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-25673832-498b-4b0b-95bc-1b813b1ab9bd tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:42.909204 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-25673832-498b-4b0b-95bc-1b813b1ab9bd tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] [instance: 8f231864-55f5-469d-b015-721a0ddc5e3d] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:42.937192 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-25673832-498b-4b0b-95bc-1b813b1ab9bd tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:42.938061 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-25673832-498b-4b0b-95bc-1b813b1ab9bd tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:42.943014 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-25673832-498b-4b0b-95bc-1b813b1ab9bd tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:42.943662 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-25673832-498b-4b0b-95bc-1b813b1ab9bd tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:43.191603 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-25673832-498b-4b0b-95bc-1b813b1ab9bd tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eacf11b5ea94c6386577eca24696b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cb3477628042869ffe08048f0a8ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:43.202282 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-25673832-498b-4b0b-95bc-1b813b1ab9bd tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] 10.222.0.113 "GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d" status: 200 len: 1319 microversion: 2.1 time: 0.297366 Jan 24 09:17:43.203486 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 46/84] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:42 2022] GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d => generated 1319 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:17:43.214793 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-24675d50-b802-4f44-9052-0df10b474bc9 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:43.214793 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-24675d50-b802-4f44-9052-0df10b474bc9 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:43.216340 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-24675d50-b802-4f44-9052-0df10b474bc9 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:43.216789 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-24675d50-b802-4f44-9052-0df10b474bc9 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:43.217739 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-24675d50-b802-4f44-9052-0df10b474bc9 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:43.218200 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-24675d50-b802-4f44-9052-0df10b474bc9 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:43.247967 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-8bc375d9-f789-4394-a330-49491911982d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:43.258865 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-8bc375d9-f789-4394-a330-49491911982d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691" status: 200 len: 1322 microversion: 2.1 time: 0.446009 Jan 24 09:17:43.259956 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 39/85] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:42 2022] GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691 => generated 1322 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:43.314952 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-24675d50-b802-4f44-9052-0df10b474bc9 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:43.324493 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-24675d50-b802-4f44-9052-0df10b474bc9 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:43.333105 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-24675d50-b802-4f44-9052-0df10b474bc9 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:43.333105 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-24675d50-b802-4f44-9052-0df10b474bc9 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1337 microversion: 2.20 time: 0.123739 Jan 24 09:17:43.333105 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 47/86] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:17:43 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1337 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:17:43.392399 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-847bfa6c-c77a-4ebb-81cd-763258e70aff tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:43.393285 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-847bfa6c-c77a-4ebb-81cd-763258e70aff tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:43.400013 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-847bfa6c-c77a-4ebb-81cd-763258e70aff tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:43.400465 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-847bfa6c-c77a-4ebb-81cd-763258e70aff tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:43.401252 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-847bfa6c-c77a-4ebb-81cd-763258e70aff tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:43.401691 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-847bfa6c-c77a-4ebb-81cd-763258e70aff tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:43.661420 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-c44bb558-defc-4592-865b-7d947639b2ae tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:43.662159 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-c44bb558-defc-4592-865b-7d947639b2ae tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:43.668400 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c44bb558-defc-4592-865b-7d947639b2ae tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:43.668931 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c44bb558-defc-4592-865b-7d947639b2ae tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:43.669778 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c44bb558-defc-4592-865b-7d947639b2ae tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:43.670320 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c44bb558-defc-4592-865b-7d947639b2ae tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:43.739531 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-c44bb558-defc-4592-865b-7d947639b2ae tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:43.747490 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-c44bb558-defc-4592-865b-7d947639b2ae tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1293 microversion: 2.1 time: 0.090489 Jan 24 09:17:43.748144 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 48/87] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:43 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1293 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:17:44.027643 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-847bfa6c-c77a-4ebb-81cd-763258e70aff tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:44.035607 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-847bfa6c-c77a-4ebb-81cd-763258e70aff tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1325 microversion: 2.1 time: 0.646507 Jan 24 09:17:44.036980 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 40/88] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:43 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1325 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:44.101760 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [req-85e71892-2914-45ff-ba4b-59d8813085af req-efeb242b-879d-4f9b-81a0-025b4180ce78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "047cd9d3-84f2-4cb0-a2ff-1439420b4f84", "tag": "8921ac36-ed44-4666-b756-63bd8f08a955"}]} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:17:44.107362 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:17:44.107362 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: warnings.warn(msg) Jan 24 09:17:44.121390 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-85e71892-2914-45ff-ba4b-59d8813085af req-efeb242b-879d-4f9b-81a0-025b4180ce78 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:44.121976 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-85e71892-2914-45ff-ba4b-59d8813085af req-efeb242b-879d-4f9b-81a0-025b4180ce78 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:44.136316 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.compute.server_external_events [req-85e71892-2914-45ff-ba4b-59d8813085af req-efeb242b-879d-4f9b-81a0-025b4180ce78 service nova] Creating event network-changed:8921ac36-ed44-4666-b756-63bd8f08a955 for instance 047cd9d3-84f2-4cb0-a2ff-1439420b4f84 on hv-cinder-80403 Jan 24 09:17:44.162575 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [req-85e71892-2914-45ff-ba4b-59d8813085af req-efeb242b-879d-4f9b-81a0-025b4180ce78 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062744 Jan 24 09:17:44.163322 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 49/89] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:17:44.220327 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-2e32b4c7-12f2-45c1-ace5-3ffef53a705f tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:44.220915 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-2e32b4c7-12f2-45c1-ace5-3ffef53a705f tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] [instance: 8f231864-55f5-469d-b015-721a0ddc5e3d] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:44.227682 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-2e32b4c7-12f2-45c1-ace5-3ffef53a705f tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:44.228143 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-2e32b4c7-12f2-45c1-ace5-3ffef53a705f tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:44.228917 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-2e32b4c7-12f2-45c1-ace5-3ffef53a705f tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:44.229357 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-2e32b4c7-12f2-45c1-ace5-3ffef53a705f tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:44.276013 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-97084747-bbf5-474d-9aae-850da71239dd tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:44.276892 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-97084747-bbf5-474d-9aae-850da71239dd tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 334e86b7-8556-46c7-aad6-e5b2af845691] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:44.309724 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-97084747-bbf5-474d-9aae-850da71239dd tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:44.310231 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-97084747-bbf5-474d-9aae-850da71239dd tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:44.311262 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-97084747-bbf5-474d-9aae-850da71239dd tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:44.312997 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-97084747-bbf5-474d-9aae-850da71239dd tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:44.472939 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-97084747-bbf5-474d-9aae-850da71239dd tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:44.481217 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-97084747-bbf5-474d-9aae-850da71239dd tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691" status: 200 len: 1322 microversion: 2.1 time: 0.209090 Jan 24 09:17:44.481797 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 50/90] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:44 2022] GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691 => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:44.486557 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-92f6c4fa-0ffc-4e4d-a588-0f08388a8cc2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:44.488540 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-92f6c4fa-0ffc-4e4d-a588-0f08388a8cc2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:44.489416 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-2e32b4c7-12f2-45c1-ace5-3ffef53a705f tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eacf11b5ea94c6386577eca24696b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cb3477628042869ffe08048f0a8ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:44.494986 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-92f6c4fa-0ffc-4e4d-a588-0f08388a8cc2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:44.495430 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-92f6c4fa-0ffc-4e4d-a588-0f08388a8cc2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:44.496213 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-92f6c4fa-0ffc-4e4d-a588-0f08388a8cc2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:44.496649 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-92f6c4fa-0ffc-4e4d-a588-0f08388a8cc2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:44.496877 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-2e32b4c7-12f2-45c1-ace5-3ffef53a705f tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] 10.222.0.113 "GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d" status: 200 len: 1319 microversion: 2.1 time: 0.280250 Jan 24 09:17:44.497652 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 41/91] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:44 2022] GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d => generated 1319 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:44.557449 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-92f6c4fa-0ffc-4e4d-a588-0f08388a8cc2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:44.567450 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-92f6c4fa-0ffc-4e4d-a588-0f08388a8cc2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:44.569997 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-92f6c4fa-0ffc-4e4d-a588-0f08388a8cc2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:44.571659 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-92f6c4fa-0ffc-4e4d-a588-0f08388a8cc2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1343 microversion: 2.20 time: 0.088680 Jan 24 09:17:44.572661 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 51/92] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:17:44 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1343 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:17:44.764700 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-856a6bc3-9702-4025-9218-6f870d78fe76 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:44.765313 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-856a6bc3-9702-4025-9218-6f870d78fe76 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:44.771417 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-856a6bc3-9702-4025-9218-6f870d78fe76 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:44.771865 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-856a6bc3-9702-4025-9218-6f870d78fe76 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:44.772672 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-856a6bc3-9702-4025-9218-6f870d78fe76 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:44.773100 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-856a6bc3-9702-4025-9218-6f870d78fe76 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:44.841641 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-856a6bc3-9702-4025-9218-6f870d78fe76 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:44.850076 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-856a6bc3-9702-4025-9218-6f870d78fe76 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1301 microversion: 2.1 time: 0.088916 Jan 24 09:17:44.851081 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 42/93] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:44 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1301 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:45.053182 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-d4ab6675-487c-4463-bb63-40297bbeaa01 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:45.053793 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-d4ab6675-487c-4463-bb63-40297bbeaa01 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:45.060152 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d4ab6675-487c-4463-bb63-40297bbeaa01 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:45.060608 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d4ab6675-487c-4463-bb63-40297bbeaa01 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:45.061433 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d4ab6675-487c-4463-bb63-40297bbeaa01 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:45.061874 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d4ab6675-487c-4463-bb63-40297bbeaa01 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:45.217042 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-d4ab6675-487c-4463-bb63-40297bbeaa01 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:45.224628 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-d4ab6675-487c-4463-bb63-40297bbeaa01 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1325 microversion: 2.1 time: 0.175273 Jan 24 09:17:45.225200 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 52/94] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:45 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1325 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:45.499719 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-4fe2c8f7-200c-4d2d-832a-4693c9aeed2f tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:45.500331 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-4fe2c8f7-200c-4d2d-832a-4693c9aeed2f tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 334e86b7-8556-46c7-aad6-e5b2af845691] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:45.507788 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4fe2c8f7-200c-4d2d-832a-4693c9aeed2f tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:45.508303 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4fe2c8f7-200c-4d2d-832a-4693c9aeed2f tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:45.509029 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4fe2c8f7-200c-4d2d-832a-4693c9aeed2f tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:45.509621 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4fe2c8f7-200c-4d2d-832a-4693c9aeed2f tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:45.515160 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-f47c3301-4cee-47a3-8a08-49c3b33e2d7b tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:45.515773 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-f47c3301-4cee-47a3-8a08-49c3b33e2d7b tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] [instance: 8f231864-55f5-469d-b015-721a0ddc5e3d] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:45.525738 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f47c3301-4cee-47a3-8a08-49c3b33e2d7b tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:45.526212 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f47c3301-4cee-47a3-8a08-49c3b33e2d7b tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:45.527807 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f47c3301-4cee-47a3-8a08-49c3b33e2d7b tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:45.528767 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f47c3301-4cee-47a3-8a08-49c3b33e2d7b tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:45.694489 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-f47c3301-4cee-47a3-8a08-49c3b33e2d7b tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eacf11b5ea94c6386577eca24696b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cb3477628042869ffe08048f0a8ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:45.702823 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-f47c3301-4cee-47a3-8a08-49c3b33e2d7b tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] 10.222.0.113 "GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d" status: 200 len: 1319 microversion: 2.1 time: 0.192060 Jan 24 09:17:45.704376 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 53/95] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:45 2022] GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:45.710904 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-cd628c23-9977-4942-a9d8-d4e217e5fd76 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:45.711833 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-cd628c23-9977-4942-a9d8-d4e217e5fd76 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:45.717726 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-4fe2c8f7-200c-4d2d-832a-4693c9aeed2f tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:45.720112 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-cd628c23-9977-4942-a9d8-d4e217e5fd76 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:45.721730 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-cd628c23-9977-4942-a9d8-d4e217e5fd76 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:45.726836 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-cd628c23-9977-4942-a9d8-d4e217e5fd76 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:45.726836 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-cd628c23-9977-4942-a9d8-d4e217e5fd76 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:45.727384 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-4fe2c8f7-200c-4d2d-832a-4693c9aeed2f tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691" status: 200 len: 1322 microversion: 2.1 time: 0.231281 Jan 24 09:17:45.728039 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 43/96] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:45 2022] GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:17:45.791841 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-cd628c23-9977-4942-a9d8-d4e217e5fd76 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:45.799864 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-cd628c23-9977-4942-a9d8-d4e217e5fd76 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:45.802007 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-cd628c23-9977-4942-a9d8-d4e217e5fd76 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:45.803425 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-cd628c23-9977-4942-a9d8-d4e217e5fd76 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1343 microversion: 2.20 time: 0.097511 Jan 24 09:17:45.804014 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 54/97] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:17:45 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1343 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:17:45.871850 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-664683db-1d60-4b22-aff9-da77697424fd tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:45.872493 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-664683db-1d60-4b22-aff9-da77697424fd tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:45.881155 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-664683db-1d60-4b22-aff9-da77697424fd tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:45.881618 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-664683db-1d60-4b22-aff9-da77697424fd tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:45.883363 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-664683db-1d60-4b22-aff9-da77697424fd tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:45.883816 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-664683db-1d60-4b22-aff9-da77697424fd tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:45.952683 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-664683db-1d60-4b22-aff9-da77697424fd tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:45.960196 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-664683db-1d60-4b22-aff9-da77697424fd tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1301 microversion: 2.1 time: 0.096061 Jan 24 09:17:45.960765 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 44/98] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:45 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1301 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:46.191790 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [req-8e901d92-4175-4660-97b3-bd8fff1664f4 req-82c501ba-e556-40e1-9f57-5b1e13a72fd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c90c156b-e532-4c87-b23c-3d4326e991bd", "tag": "5e0c4cdf-09d8-44d6-8bce-e6c6ed362462"}]} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:17:46.193530 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:17:46.193530 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: warnings.warn(msg) Jan 24 09:17:46.201900 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-8e901d92-4175-4660-97b3-bd8fff1664f4 req-82c501ba-e556-40e1-9f57-5b1e13a72fd1 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:46.202676 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-8e901d92-4175-4660-97b3-bd8fff1664f4 req-82c501ba-e556-40e1-9f57-5b1e13a72fd1 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:46.215755 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.compute.server_external_events [req-8e901d92-4175-4660-97b3-bd8fff1664f4 req-82c501ba-e556-40e1-9f57-5b1e13a72fd1 service nova] Creating event network-changed:5e0c4cdf-09d8-44d6-8bce-e6c6ed362462 for instance c90c156b-e532-4c87-b23c-3d4326e991bd on hv-cinder-80403 Jan 24 09:17:46.221060 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [req-8e901d92-4175-4660-97b3-bd8fff1664f4 req-82c501ba-e556-40e1-9f57-5b1e13a72fd1 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033304 Jan 24 09:17:46.221917 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 55/99] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:17:46.240599 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-977a85b0-dafe-48d0-a06c-09bd97280f86 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:46.241277 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-977a85b0-dafe-48d0-a06c-09bd97280f86 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:46.247242 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-977a85b0-dafe-48d0-a06c-09bd97280f86 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:46.247799 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-977a85b0-dafe-48d0-a06c-09bd97280f86 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:46.248609 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-977a85b0-dafe-48d0-a06c-09bd97280f86 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:46.252686 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-977a85b0-dafe-48d0-a06c-09bd97280f86 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:46.402262 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-977a85b0-dafe-48d0-a06c-09bd97280f86 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:46.404186 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-977a85b0-dafe-48d0-a06c-09bd97280f86 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1325 microversion: 2.1 time: 0.167271 Jan 24 09:17:46.404781 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 45/100] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:46 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1325 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:46.723134 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-ec9fa6cf-64da-4a21-a238-82c5aeffb011 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:46.724155 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-ec9fa6cf-64da-4a21-a238-82c5aeffb011 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] [instance: 8f231864-55f5-469d-b015-721a0ddc5e3d] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:46.730390 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ec9fa6cf-64da-4a21-a238-82c5aeffb011 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:46.731253 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ec9fa6cf-64da-4a21-a238-82c5aeffb011 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:46.732261 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ec9fa6cf-64da-4a21-a238-82c5aeffb011 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:46.732906 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ec9fa6cf-64da-4a21-a238-82c5aeffb011 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:46.744495 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-5122e106-4d57-403e-a2b7-b8a7d8b0652b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:46.745103 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-5122e106-4d57-403e-a2b7-b8a7d8b0652b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 334e86b7-8556-46c7-aad6-e5b2af845691] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:46.752273 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5122e106-4d57-403e-a2b7-b8a7d8b0652b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:46.752947 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5122e106-4d57-403e-a2b7-b8a7d8b0652b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:46.754820 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5122e106-4d57-403e-a2b7-b8a7d8b0652b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:46.755703 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5122e106-4d57-403e-a2b7-b8a7d8b0652b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:46.880525 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-ec9fa6cf-64da-4a21-a238-82c5aeffb011 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eacf11b5ea94c6386577eca24696b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cb3477628042869ffe08048f0a8ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:46.901968 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-ec9fa6cf-64da-4a21-a238-82c5aeffb011 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] 10.222.0.113 "GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d" status: 200 len: 1319 microversion: 2.1 time: 0.183180 Jan 24 09:17:46.902620 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 56/101] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:46 2022] GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:46.919126 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-5106a4a5-57ef-426b-b9cc-bd6affa2e382 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:46.919875 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-5106a4a5-57ef-426b-b9cc-bd6affa2e382 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:46.939314 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5106a4a5-57ef-426b-b9cc-bd6affa2e382 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:46.939762 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5106a4a5-57ef-426b-b9cc-bd6affa2e382 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:46.941421 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-5122e106-4d57-403e-a2b7-b8a7d8b0652b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:46.941563 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5106a4a5-57ef-426b-b9cc-bd6affa2e382 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:46.941983 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5106a4a5-57ef-426b-b9cc-bd6affa2e382 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:46.956374 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-5122e106-4d57-403e-a2b7-b8a7d8b0652b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691" status: 200 len: 1322 microversion: 2.1 time: 0.215185 Jan 24 09:17:46.956961 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 46/102] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:46 2022] GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:17:46.976907 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-25e97e06-b487-44ed-b68d-a28668d9d972 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:46.978818 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-25e97e06-b487-44ed-b68d-a28668d9d972 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:47.003923 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-25e97e06-b487-44ed-b68d-a28668d9d972 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:47.003923 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-25e97e06-b487-44ed-b68d-a28668d9d972 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:47.003923 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-25e97e06-b487-44ed-b68d-a28668d9d972 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:47.003923 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-25e97e06-b487-44ed-b68d-a28668d9d972 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:47.100471 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-5106a4a5-57ef-426b-b9cc-bd6affa2e382 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:47.116482 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-5106a4a5-57ef-426b-b9cc-bd6affa2e382 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:47.126692 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-5106a4a5-57ef-426b-b9cc-bd6affa2e382 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:47.126692 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-5106a4a5-57ef-426b-b9cc-bd6affa2e382 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1343 microversion: 2.20 time: 0.220588 Jan 24 09:17:47.126692 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 57/103] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:17:46 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1343 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:17:47.207216 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-25e97e06-b487-44ed-b68d-a28668d9d972 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:47.215563 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-25e97e06-b487-44ed-b68d-a28668d9d972 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1301 microversion: 2.1 time: 0.242283 Jan 24 09:17:47.216496 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 47/104] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:46 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1301 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:47.420629 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-47a0af8c-db54-450a-ad3b-07f9be5c0153 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:47.422005 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-47a0af8c-db54-450a-ad3b-07f9be5c0153 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:47.453015 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-47a0af8c-db54-450a-ad3b-07f9be5c0153 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:47.467932 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-47a0af8c-db54-450a-ad3b-07f9be5c0153 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:47.469376 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-47a0af8c-db54-450a-ad3b-07f9be5c0153 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:47.470034 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-47a0af8c-db54-450a-ad3b-07f9be5c0153 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:47.924445 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-4795c903-a7a1-4b20-8827-4011ac7d9dcf tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:47.926253 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-4795c903-a7a1-4b20-8827-4011ac7d9dcf tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] [instance: 8f231864-55f5-469d-b015-721a0ddc5e3d] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:47.938846 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4795c903-a7a1-4b20-8827-4011ac7d9dcf tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:47.942810 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4795c903-a7a1-4b20-8827-4011ac7d9dcf tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:47.944567 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4795c903-a7a1-4b20-8827-4011ac7d9dcf tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:47.948016 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4795c903-a7a1-4b20-8827-4011ac7d9dcf tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:48.047110 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-47a0af8c-db54-450a-ad3b-07f9be5c0153 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:48.058451 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-47a0af8c-db54-450a-ad3b-07f9be5c0153 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1325 microversion: 2.1 time: 0.638362 Jan 24 09:17:48.060233 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 58/105] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:47 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1325 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:48.068232 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-c839148f-c631-487c-b386-775cd5468f97 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:48.072516 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-c839148f-c631-487c-b386-775cd5468f97 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 334e86b7-8556-46c7-aad6-e5b2af845691] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:48.091340 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c839148f-c631-487c-b386-775cd5468f97 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:48.093280 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c839148f-c631-487c-b386-775cd5468f97 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:48.095843 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c839148f-c631-487c-b386-775cd5468f97 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:48.097626 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c839148f-c631-487c-b386-775cd5468f97 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:48.354856 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-c839148f-c631-487c-b386-775cd5468f97 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:48.364309 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-c839148f-c631-487c-b386-775cd5468f97 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691" status: 200 len: 1322 microversion: 2.1 time: 0.300480 Jan 24 09:17:48.366827 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 59/106] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:48 2022] GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691 => generated 1322 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:48.373303 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-0d0726f1-77f5-4d1f-a8c3-f81cd4ecdb31 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:48.378930 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-0d0726f1-77f5-4d1f-a8c3-f81cd4ecdb31 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:48.385881 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0d0726f1-77f5-4d1f-a8c3-f81cd4ecdb31 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:48.386926 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0d0726f1-77f5-4d1f-a8c3-f81cd4ecdb31 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:48.388035 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0d0726f1-77f5-4d1f-a8c3-f81cd4ecdb31 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:48.388740 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0d0726f1-77f5-4d1f-a8c3-f81cd4ecdb31 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:48.508338 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-0d0726f1-77f5-4d1f-a8c3-f81cd4ecdb31 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:48.530061 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-0d0726f1-77f5-4d1f-a8c3-f81cd4ecdb31 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:48.531818 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-0d0726f1-77f5-4d1f-a8c3-f81cd4ecdb31 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:48.538186 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-0d0726f1-77f5-4d1f-a8c3-f81cd4ecdb31 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1343 microversion: 2.20 time: 0.170029 Jan 24 09:17:48.542472 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 60/107] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:17:48 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1343 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:17:48.550736 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-8da7efd5-4158-42a9-af3f-dc6db7592d3f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:48.551685 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-8da7efd5-4158-42a9-af3f-dc6db7592d3f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:48.562939 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-8da7efd5-4158-42a9-af3f-dc6db7592d3f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:48.564985 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-8da7efd5-4158-42a9-af3f-dc6db7592d3f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:48.566328 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-8da7efd5-4158-42a9-af3f-dc6db7592d3f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:48.567351 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-8da7efd5-4158-42a9-af3f-dc6db7592d3f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:48.650652 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-4795c903-a7a1-4b20-8827-4011ac7d9dcf tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eacf11b5ea94c6386577eca24696b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cb3477628042869ffe08048f0a8ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:48.667325 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-4795c903-a7a1-4b20-8827-4011ac7d9dcf tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] 10.222.0.113 "GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d" status: 200 len: 1319 microversion: 2.1 time: 0.746138 Jan 24 09:17:48.668287 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 48/108] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:47 2022] GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d => generated 1319 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:17:48.700678 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-8da7efd5-4158-42a9-af3f-dc6db7592d3f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:48.708711 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-8da7efd5-4158-42a9-af3f-dc6db7592d3f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1299 microversion: 2.1 time: 0.164436 Jan 24 09:17:48.710034 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 61/109] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:48 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1299 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:49.090391 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-86d7ec46-4ddd-465d-a56f-62275f664206 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:49.091601 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-86d7ec46-4ddd-465d-a56f-62275f664206 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:49.098680 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-86d7ec46-4ddd-465d-a56f-62275f664206 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:49.099185 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-86d7ec46-4ddd-465d-a56f-62275f664206 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:49.100367 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-86d7ec46-4ddd-465d-a56f-62275f664206 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:49.100802 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-86d7ec46-4ddd-465d-a56f-62275f664206 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:49.385562 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-5e3699e0-7226-4d81-a270-58de0da28bfc tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:49.387175 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-5e3699e0-7226-4d81-a270-58de0da28bfc tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 334e86b7-8556-46c7-aad6-e5b2af845691] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:49.394763 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5e3699e0-7226-4d81-a270-58de0da28bfc tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:49.401437 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5e3699e0-7226-4d81-a270-58de0da28bfc tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:49.401437 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5e3699e0-7226-4d81-a270-58de0da28bfc tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:49.401437 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5e3699e0-7226-4d81-a270-58de0da28bfc tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:49.517120 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-86d7ec46-4ddd-465d-a56f-62275f664206 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:49.525570 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-86d7ec46-4ddd-465d-a56f-62275f664206 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1325 microversion: 2.1 time: 0.438965 Jan 24 09:17:49.527359 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 49/110] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:49 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1325 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:49.561628 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-f3f4dbb7-6bc0-4a81-87e8-ca9578e7c8d5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:49.562519 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-f3f4dbb7-6bc0-4a81-87e8-ca9578e7c8d5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:49.571122 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f3f4dbb7-6bc0-4a81-87e8-ca9578e7c8d5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:49.571555 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f3f4dbb7-6bc0-4a81-87e8-ca9578e7c8d5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:49.572545 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f3f4dbb7-6bc0-4a81-87e8-ca9578e7c8d5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:49.573028 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f3f4dbb7-6bc0-4a81-87e8-ca9578e7c8d5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:49.625535 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-5e3699e0-7226-4d81-a270-58de0da28bfc tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:49.639620 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-5e3699e0-7226-4d81-a270-58de0da28bfc tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691" status: 200 len: 1322 microversion: 2.1 time: 0.259741 Jan 24 09:17:49.640513 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 62/111] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:49 2022] GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691 => generated 1322 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:17:49.689347 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-399c4447-1ac4-44e6-ab0b-4680369ff6e1 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:49.692716 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-399c4447-1ac4-44e6-ab0b-4680369ff6e1 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] [instance: 8f231864-55f5-469d-b015-721a0ddc5e3d] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:49.712715 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-399c4447-1ac4-44e6-ab0b-4680369ff6e1 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:49.713805 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-399c4447-1ac4-44e6-ab0b-4680369ff6e1 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:49.716437 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-399c4447-1ac4-44e6-ab0b-4680369ff6e1 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:49.716669 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-399c4447-1ac4-44e6-ab0b-4680369ff6e1 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:49.996989 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-f3f4dbb7-6bc0-4a81-87e8-ca9578e7c8d5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:50.012242 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-f3f4dbb7-6bc0-4a81-87e8-ca9578e7c8d5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:50.012242 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-f3f4dbb7-6bc0-4a81-87e8-ca9578e7c8d5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:50.018477 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-f3f4dbb7-6bc0-4a81-87e8-ca9578e7c8d5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1411 microversion: 2.20 time: 0.455755 Jan 24 09:17:50.020848 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 50/112] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:17:49 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1411 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:17:50.025326 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-4fe772ce-3dac-4d46-8034-080b33f1dc32 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:50.025944 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-4fe772ce-3dac-4d46-8034-080b33f1dc32 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:50.051143 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4fe772ce-3dac-4d46-8034-080b33f1dc32 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:50.051696 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4fe772ce-3dac-4d46-8034-080b33f1dc32 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:50.053755 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-399c4447-1ac4-44e6-ab0b-4680369ff6e1 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eacf11b5ea94c6386577eca24696b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cb3477628042869ffe08048f0a8ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:50.057049 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4fe772ce-3dac-4d46-8034-080b33f1dc32 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:50.057514 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4fe772ce-3dac-4d46-8034-080b33f1dc32 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:50.072802 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-399c4447-1ac4-44e6-ab0b-4680369ff6e1 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] 10.222.0.113 "GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d" status: 200 len: 1319 microversion: 2.1 time: 0.389964 Jan 24 09:17:50.079032 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 63/113] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:49 2022] GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d => generated 1319 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:50.536912 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-4fe772ce-3dac-4d46-8034-080b33f1dc32 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:50.547792 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-4393b6db-62a1-446c-b00f-8817d99754ca tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:50.549589 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-4393b6db-62a1-446c-b00f-8817d99754ca tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:50.569723 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-4fe772ce-3dac-4d46-8034-080b33f1dc32 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1366 microversion: 2.1 time: 0.547771 Jan 24 09:17:50.570351 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 51/114] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:50 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1366 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:50.573149 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4393b6db-62a1-446c-b00f-8817d99754ca tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:50.573893 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4393b6db-62a1-446c-b00f-8817d99754ca tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:50.575174 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4393b6db-62a1-446c-b00f-8817d99754ca tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:50.576798 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4393b6db-62a1-446c-b00f-8817d99754ca tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:50.663263 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-35c0c240-4ce1-463b-9f4a-98762cf776c1 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:50.663882 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-35c0c240-4ce1-463b-9f4a-98762cf776c1 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 334e86b7-8556-46c7-aad6-e5b2af845691] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:50.684364 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-35c0c240-4ce1-463b-9f4a-98762cf776c1 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:50.684944 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-35c0c240-4ce1-463b-9f4a-98762cf776c1 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:50.685748 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-35c0c240-4ce1-463b-9f4a-98762cf776c1 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:50.686208 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-35c0c240-4ce1-463b-9f4a-98762cf776c1 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:50.840854 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-4393b6db-62a1-446c-b00f-8817d99754ca tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:50.855500 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-4393b6db-62a1-446c-b00f-8817d99754ca tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1325 microversion: 2.1 time: 0.314249 Jan 24 09:17:50.864731 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 64/115] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:50 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1325 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:51.029158 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-35c0c240-4ce1-463b-9f4a-98762cf776c1 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:51.053118 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-98ccdc5a-bad9-4d81-8c8c-1e5b0e57cfd7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:51.054985 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-98ccdc5a-bad9-4d81-8c8c-1e5b0e57cfd7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:51.067313 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-35c0c240-4ce1-463b-9f4a-98762cf776c1 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691" status: 200 len: 1322 microversion: 2.1 time: 0.405753 Jan 24 09:17:51.070150 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-98ccdc5a-bad9-4d81-8c8c-1e5b0e57cfd7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:51.078056 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 52/116] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:50 2022] GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691 => generated 1322 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:51.079157 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-98ccdc5a-bad9-4d81-8c8c-1e5b0e57cfd7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:51.079157 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-98ccdc5a-bad9-4d81-8c8c-1e5b0e57cfd7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:51.079157 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-98ccdc5a-bad9-4d81-8c8c-1e5b0e57cfd7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:51.093729 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-d0df7ef2-4ac3-4fc6-9582-b5a1a5f64cdf tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:51.099525 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-d0df7ef2-4ac3-4fc6-9582-b5a1a5f64cdf tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] [instance: 8f231864-55f5-469d-b015-721a0ddc5e3d] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:51.119013 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d0df7ef2-4ac3-4fc6-9582-b5a1a5f64cdf tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:51.120080 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d0df7ef2-4ac3-4fc6-9582-b5a1a5f64cdf tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:51.122513 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d0df7ef2-4ac3-4fc6-9582-b5a1a5f64cdf tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:51.124966 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d0df7ef2-4ac3-4fc6-9582-b5a1a5f64cdf tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:51.311946 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-98ccdc5a-bad9-4d81-8c8c-1e5b0e57cfd7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:51.320624 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-98ccdc5a-bad9-4d81-8c8c-1e5b0e57cfd7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:51.322126 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-98ccdc5a-bad9-4d81-8c8c-1e5b0e57cfd7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:51.323590 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-98ccdc5a-bad9-4d81-8c8c-1e5b0e57cfd7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1411 microversion: 2.20 time: 0.290668 Jan 24 09:17:51.342315 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 65/117] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:17:51 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1411 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:17:51.613625 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [req-4e48e8b8-8a9c-4de5-a0de-454f96ddd21b req-15c6dd34-9158-46f7-8198-feb06160e4d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "334e86b7-8556-46c7-aad6-e5b2af845691", "name": "network-vif-plugged", "status": "completed", "tag": "9d784b74-8dec-426c-928f-bed55e1f51fe"}]} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:17:51.619077 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:17:51.619077 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: warnings.warn(msg) Jan 24 09:17:51.626457 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-4e48e8b8-8a9c-4de5-a0de-454f96ddd21b req-15c6dd34-9158-46f7-8198-feb06160e4d2 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:51.631375 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-4e48e8b8-8a9c-4de5-a0de-454f96ddd21b req-15c6dd34-9158-46f7-8198-feb06160e4d2 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:51.654162 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.compute.server_external_events [req-4e48e8b8-8a9c-4de5-a0de-454f96ddd21b req-15c6dd34-9158-46f7-8198-feb06160e4d2 service nova] Creating event network-vif-plugged:9d784b74-8dec-426c-928f-bed55e1f51fe for instance 334e86b7-8556-46c7-aad6-e5b2af845691 on hv-cinder-80403 Jan 24 09:17:51.668139 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [req-4e48e8b8-8a9c-4de5-a0de-454f96ddd21b req-15c6dd34-9158-46f7-8198-feb06160e4d2 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.331796 Jan 24 09:17:51.669183 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 66/118] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:17:51.681938 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-d0df7ef2-4ac3-4fc6-9582-b5a1a5f64cdf tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eacf11b5ea94c6386577eca24696b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cb3477628042869ffe08048f0a8ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:51.686173 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [req-713d09da-af2c-4f98-b644-d84539cba9ca req-2972fea3-c1c9-444d-a5f9-559e4de96147 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b820c156-179a-4172-a02b-6c88713087f1", "tag": "73ec9bcf-7f40-4fd5-9968-de1accae6f03"}]} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:17:51.694439 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:17:51.694439 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: warnings.warn(msg) Jan 24 09:17:51.696984 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-d0df7ef2-4ac3-4fc6-9582-b5a1a5f64cdf tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] 10.222.0.113 "GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d" status: 200 len: 1319 microversion: 2.1 time: 0.608306 Jan 24 09:17:51.699458 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 53/119] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:51 2022] GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d => generated 1319 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:51.708504 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-77dc55b5-33b6-4817-81c3-1b943463fa1f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:51.709593 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-77dc55b5-33b6-4817-81c3-1b943463fa1f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:51.711817 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-713d09da-af2c-4f98-b644-d84539cba9ca req-2972fea3-c1c9-444d-a5f9-559e4de96147 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:51.712272 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-713d09da-af2c-4f98-b644-d84539cba9ca req-2972fea3-c1c9-444d-a5f9-559e4de96147 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:51.718155 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-77dc55b5-33b6-4817-81c3-1b943463fa1f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:51.718861 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-77dc55b5-33b6-4817-81c3-1b943463fa1f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:51.719785 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-77dc55b5-33b6-4817-81c3-1b943463fa1f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:51.720326 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-77dc55b5-33b6-4817-81c3-1b943463fa1f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:51.735090 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.compute.server_external_events [req-713d09da-af2c-4f98-b644-d84539cba9ca req-2972fea3-c1c9-444d-a5f9-559e4de96147 service nova] Creating event network-changed:73ec9bcf-7f40-4fd5-9968-de1accae6f03 for instance b820c156-179a-4172-a02b-6c88713087f1 on hv-cinder-80403 Jan 24 09:17:51.748398 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [req-713d09da-af2c-4f98-b644-d84539cba9ca req-2972fea3-c1c9-444d-a5f9-559e4de96147 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076565 Jan 24 09:17:51.749604 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 67/120] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:17:51.879265 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-2d3fc2f6-0fb3-4ed5-ab44-5ca57a14467c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:51.879984 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-2d3fc2f6-0fb3-4ed5-ab44-5ca57a14467c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:51.891190 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2d3fc2f6-0fb3-4ed5-ab44-5ca57a14467c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:51.891730 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2d3fc2f6-0fb3-4ed5-ab44-5ca57a14467c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:51.892658 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2d3fc2f6-0fb3-4ed5-ab44-5ca57a14467c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:51.893173 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2d3fc2f6-0fb3-4ed5-ab44-5ca57a14467c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:51.935141 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-77dc55b5-33b6-4817-81c3-1b943463fa1f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:51.947056 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-77dc55b5-33b6-4817-81c3-1b943463fa1f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1366 microversion: 2.1 time: 0.245607 Jan 24 09:17:51.962556 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 54/121] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:51 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1366 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:52.093934 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-ac32ea50-7a91-4f1e-9a2f-a6a42d73afb5 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:52.094744 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-ac32ea50-7a91-4f1e-9a2f-a6a42d73afb5 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 334e86b7-8556-46c7-aad6-e5b2af845691] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:52.103653 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ac32ea50-7a91-4f1e-9a2f-a6a42d73afb5 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:52.104155 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ac32ea50-7a91-4f1e-9a2f-a6a42d73afb5 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:52.104606 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-2d3fc2f6-0fb3-4ed5-ab44-5ca57a14467c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:52.105824 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ac32ea50-7a91-4f1e-9a2f-a6a42d73afb5 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:52.106410 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ac32ea50-7a91-4f1e-9a2f-a6a42d73afb5 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:52.119861 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-2d3fc2f6-0fb3-4ed5-ab44-5ca57a14467c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1325 microversion: 2.1 time: 0.243831 Jan 24 09:17:52.137802 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 68/122] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:51 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1325 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:17:52.312782 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-ac32ea50-7a91-4f1e-9a2f-a6a42d73afb5 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:52.320364 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-ac32ea50-7a91-4f1e-9a2f-a6a42d73afb5 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691" status: 200 len: 1322 microversion: 2.1 time: 0.230644 Jan 24 09:17:52.320949 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 55/123] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:52 2022] GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691 => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:17:52.343085 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-f3887c79-b50e-4792-9039-66699b5ca787 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:52.343875 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-f3887c79-b50e-4792-9039-66699b5ca787 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:52.351138 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f3887c79-b50e-4792-9039-66699b5ca787 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:52.351588 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f3887c79-b50e-4792-9039-66699b5ca787 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:52.352696 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f3887c79-b50e-4792-9039-66699b5ca787 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:52.353300 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f3887c79-b50e-4792-9039-66699b5ca787 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:52.517096 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-f3887c79-b50e-4792-9039-66699b5ca787 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:52.525598 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-f3887c79-b50e-4792-9039-66699b5ca787 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:52.527193 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-f3887c79-b50e-4792-9039-66699b5ca787 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:52.528353 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-f3887c79-b50e-4792-9039-66699b5ca787 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1411 microversion: 2.20 time: 0.189346 Jan 24 09:17:52.528965 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 69/124] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:17:52 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1411 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:17:52.716997 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-289a2ef0-a66a-488a-ab83-438b207a82cf tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:52.717720 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-289a2ef0-a66a-488a-ab83-438b207a82cf tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] [instance: 8f231864-55f5-469d-b015-721a0ddc5e3d] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:52.725088 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-289a2ef0-a66a-488a-ab83-438b207a82cf tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:52.725530 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-289a2ef0-a66a-488a-ab83-438b207a82cf tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:52.726467 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-289a2ef0-a66a-488a-ab83-438b207a82cf tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:52.726821 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-289a2ef0-a66a-488a-ab83-438b207a82cf tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:52.884275 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-289a2ef0-a66a-488a-ab83-438b207a82cf tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eacf11b5ea94c6386577eca24696b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cb3477628042869ffe08048f0a8ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:52.891850 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-289a2ef0-a66a-488a-ab83-438b207a82cf tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] 10.222.0.113 "GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d" status: 200 len: 1319 microversion: 2.1 time: 0.179675 Jan 24 09:17:52.892644 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 56/125] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:52 2022] GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:17:52.968392 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-4df7da90-fffe-45c2-954a-ed1805c64d93 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:52.969026 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-4df7da90-fffe-45c2-954a-ed1805c64d93 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:52.976084 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4df7da90-fffe-45c2-954a-ed1805c64d93 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:52.976535 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4df7da90-fffe-45c2-954a-ed1805c64d93 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:52.977320 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4df7da90-fffe-45c2-954a-ed1805c64d93 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:52.977748 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4df7da90-fffe-45c2-954a-ed1805c64d93 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:53.110041 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-4df7da90-fffe-45c2-954a-ed1805c64d93 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:53.117748 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-4df7da90-fffe-45c2-954a-ed1805c64d93 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1366 microversion: 2.1 time: 0.153024 Jan 24 09:17:53.118678 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 70/126] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:52 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:53.144626 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-90f69bde-becb-47a7-b16d-15ed330d7b59 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:53.145236 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-90f69bde-becb-47a7-b16d-15ed330d7b59 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:53.151307 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-90f69bde-becb-47a7-b16d-15ed330d7b59 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:53.151623 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-90f69bde-becb-47a7-b16d-15ed330d7b59 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:53.152409 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-90f69bde-becb-47a7-b16d-15ed330d7b59 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:53.152905 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-90f69bde-becb-47a7-b16d-15ed330d7b59 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:53.288747 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-90f69bde-becb-47a7-b16d-15ed330d7b59 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:53.295898 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-90f69bde-becb-47a7-b16d-15ed330d7b59 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1325 microversion: 2.1 time: 0.155578 Jan 24 09:17:53.296468 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 57/127] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:53 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1325 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:53.337125 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-4a1d8bbc-af3a-4aee-bc30-02a2bd8309ce tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:53.337739 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-4a1d8bbc-af3a-4aee-bc30-02a2bd8309ce tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 334e86b7-8556-46c7-aad6-e5b2af845691] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:53.343788 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4a1d8bbc-af3a-4aee-bc30-02a2bd8309ce tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:53.344241 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4a1d8bbc-af3a-4aee-bc30-02a2bd8309ce tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:53.345045 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4a1d8bbc-af3a-4aee-bc30-02a2bd8309ce tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:53.345482 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4a1d8bbc-af3a-4aee-bc30-02a2bd8309ce tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:53.510738 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-4a1d8bbc-af3a-4aee-bc30-02a2bd8309ce tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:53.519676 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-4a1d8bbc-af3a-4aee-bc30-02a2bd8309ce tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691" status: 200 len: 1322 microversion: 2.1 time: 0.186087 Jan 24 09:17:53.520457 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 71/128] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:53 2022] GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:53.551028 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-0ed86616-06ff-4a4b-8e45-644f6ada6f6e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:53.551789 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-0ed86616-06ff-4a4b-8e45-644f6ada6f6e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:53.558501 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0ed86616-06ff-4a4b-8e45-644f6ada6f6e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:53.559247 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0ed86616-06ff-4a4b-8e45-644f6ada6f6e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:53.560034 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0ed86616-06ff-4a4b-8e45-644f6ada6f6e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:53.560465 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0ed86616-06ff-4a4b-8e45-644f6ada6f6e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:53.686180 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [req-04a7a83d-d517-4bd6-9a8e-2b6f0d224d26 req-e2c62153-575b-424a-9130-9e1d3e0e5088 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f231864-55f5-469d-b015-721a0ddc5e3d", "name": "network-vif-plugged", "status": "completed", "tag": "af0ff79f-46d7-41b6-adb2-1f564fafaaba"}]} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:17:53.688055 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:17:53.688055 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: warnings.warn(msg) Jan 24 09:17:53.696562 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-04a7a83d-d517-4bd6-9a8e-2b6f0d224d26 req-e2c62153-575b-424a-9130-9e1d3e0e5088 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:53.697006 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-04a7a83d-d517-4bd6-9a8e-2b6f0d224d26 req-e2c62153-575b-424a-9130-9e1d3e0e5088 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:53.708694 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.compute.server_external_events [req-04a7a83d-d517-4bd6-9a8e-2b6f0d224d26 req-e2c62153-575b-424a-9130-9e1d3e0e5088 service nova] Creating event network-vif-plugged:af0ff79f-46d7-41b6-adb2-1f564fafaaba for instance 8f231864-55f5-469d-b015-721a0ddc5e3d on hv-cinder-80403 Jan 24 09:17:53.713549 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [req-04a7a83d-d517-4bd6-9a8e-2b6f0d224d26 req-e2c62153-575b-424a-9130-9e1d3e0e5088 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030885 Jan 24 09:17:53.714266 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 72/129] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:17:53.773606 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [req-0a3f66a4-9a24-417b-8517-02d0d16db346 req-f313839e-a6c2-4766-ad3f-d3bae4aa9c4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7421454-e5c9-4ecb-8afb-928a7042b789", "tag": "93c2fd64-23e2-4383-a6ab-b95fd9eca7df"}]} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:17:53.775564 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:17:53.775564 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: warnings.warn(msg) Jan 24 09:17:53.783300 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-0a3f66a4-9a24-417b-8517-02d0d16db346 req-f313839e-a6c2-4766-ad3f-d3bae4aa9c4a service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:53.783743 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-0a3f66a4-9a24-417b-8517-02d0d16db346 req-f313839e-a6c2-4766-ad3f-d3bae4aa9c4a service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:53.797578 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.compute.server_external_events [req-0a3f66a4-9a24-417b-8517-02d0d16db346 req-f313839e-a6c2-4766-ad3f-d3bae4aa9c4a service nova] Creating event network-changed:93c2fd64-23e2-4383-a6ab-b95fd9eca7df for instance c7421454-e5c9-4ecb-8afb-928a7042b789 on hv-cinder-80403 Jan 24 09:17:53.803816 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [req-0a3f66a4-9a24-417b-8517-02d0d16db346 req-f313839e-a6c2-4766-ad3f-d3bae4aa9c4a service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035831 Jan 24 09:17:53.804825 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 73/130] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:17:53.899818 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-0ed86616-06ff-4a4b-8e45-644f6ada6f6e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:53.912769 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-9a6fb4a0-c9d7-4ef2-90d8-351833e4a03e tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:53.914122 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-9a6fb4a0-c9d7-4ef2-90d8-351833e4a03e tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] [instance: 8f231864-55f5-469d-b015-721a0ddc5e3d] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:53.925832 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-9a6fb4a0-c9d7-4ef2-90d8-351833e4a03e tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:53.926598 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-9a6fb4a0-c9d7-4ef2-90d8-351833e4a03e tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:53.928435 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-9a6fb4a0-c9d7-4ef2-90d8-351833e4a03e tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:53.929720 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-9a6fb4a0-c9d7-4ef2-90d8-351833e4a03e tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:53.937011 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-0ed86616-06ff-4a4b-8e45-644f6ada6f6e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:53.938950 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-0ed86616-06ff-4a4b-8e45-644f6ada6f6e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:53.940134 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-0ed86616-06ff-4a4b-8e45-644f6ada6f6e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1411 microversion: 2.20 time: 0.393483 Jan 24 09:17:53.944016 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 58/131] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:17:53 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1411 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:17:54.100256 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-9a6fb4a0-c9d7-4ef2-90d8-351833e4a03e tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eacf11b5ea94c6386577eca24696b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cb3477628042869ffe08048f0a8ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:54.108076 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-9a6fb4a0-c9d7-4ef2-90d8-351833e4a03e tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] 10.222.0.113 "GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d" status: 200 len: 1319 microversion: 2.1 time: 0.202992 Jan 24 09:17:54.108831 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 74/132] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:53 2022] GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:17:54.134369 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-ed92ce3c-7658-461a-b6bc-9b4c26fe7d03 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:54.135096 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-ed92ce3c-7658-461a-b6bc-9b4c26fe7d03 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:54.141232 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ed92ce3c-7658-461a-b6bc-9b4c26fe7d03 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:54.141905 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ed92ce3c-7658-461a-b6bc-9b4c26fe7d03 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:54.142717 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ed92ce3c-7658-461a-b6bc-9b4c26fe7d03 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:54.143890 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ed92ce3c-7658-461a-b6bc-9b4c26fe7d03 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:54.314994 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-684cff4b-29d6-4ee5-a338-64b447db6ee7 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:54.316919 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-684cff4b-29d6-4ee5-a338-64b447db6ee7 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:54.326155 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-684cff4b-29d6-4ee5-a338-64b447db6ee7 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:54.330570 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-684cff4b-29d6-4ee5-a338-64b447db6ee7 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:54.330570 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-684cff4b-29d6-4ee5-a338-64b447db6ee7 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:54.330570 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-684cff4b-29d6-4ee5-a338-64b447db6ee7 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:54.516118 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-684cff4b-29d6-4ee5-a338-64b447db6ee7 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:54.535547 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-684cff4b-29d6-4ee5-a338-64b447db6ee7 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1325 microversion: 2.1 time: 0.225677 Jan 24 09:17:54.536148 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 75/133] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:54 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1325 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:54.551006 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-0cebcaff-ea99-4743-b094-eb364dfbb34c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:54.551643 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-0cebcaff-ea99-4743-b094-eb364dfbb34c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 334e86b7-8556-46c7-aad6-e5b2af845691] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:54.565787 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0cebcaff-ea99-4743-b094-eb364dfbb34c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:54.566275 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0cebcaff-ea99-4743-b094-eb364dfbb34c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:54.567270 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0cebcaff-ea99-4743-b094-eb364dfbb34c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:54.567853 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0cebcaff-ea99-4743-b094-eb364dfbb34c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:54.814354 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-ed92ce3c-7658-461a-b6bc-9b4c26fe7d03 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:54.829767 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-ed92ce3c-7658-461a-b6bc-9b4c26fe7d03 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1366 microversion: 2.1 time: 0.698311 Jan 24 09:17:54.832176 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 59/134] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:54 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1366 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:54.874060 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-0cebcaff-ea99-4743-b094-eb364dfbb34c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:54.889236 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-0cebcaff-ea99-4743-b094-eb364dfbb34c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691" status: 200 len: 1322 microversion: 2.1 time: 0.350812 Jan 24 09:17:54.892192 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 76/135] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:54 2022] GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691 => generated 1322 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:54.962467 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-9843ebf0-847d-4ec3-8239-0951c9c828f9 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:54.963210 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-9843ebf0-847d-4ec3-8239-0951c9c828f9 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:54.970323 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9843ebf0-847d-4ec3-8239-0951c9c828f9 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:54.970692 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9843ebf0-847d-4ec3-8239-0951c9c828f9 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:54.972239 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9843ebf0-847d-4ec3-8239-0951c9c828f9 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:54.972928 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9843ebf0-847d-4ec3-8239-0951c9c828f9 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:55.132311 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-11c4a2eb-eb17-4c31-9cd8-3035a54b65d3 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:55.133130 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-11c4a2eb-eb17-4c31-9cd8-3035a54b65d3 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] [instance: 8f231864-55f5-469d-b015-721a0ddc5e3d] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:55.145773 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-11c4a2eb-eb17-4c31-9cd8-3035a54b65d3 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:55.146295 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-11c4a2eb-eb17-4c31-9cd8-3035a54b65d3 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:55.147102 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-11c4a2eb-eb17-4c31-9cd8-3035a54b65d3 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:55.148573 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-11c4a2eb-eb17-4c31-9cd8-3035a54b65d3 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:55.306694 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-9843ebf0-847d-4ec3-8239-0951c9c828f9 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:55.321835 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-9843ebf0-847d-4ec3-8239-0951c9c828f9 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:55.325886 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-9843ebf0-847d-4ec3-8239-0951c9c828f9 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:55.334623 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-9843ebf0-847d-4ec3-8239-0951c9c828f9 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1411 microversion: 2.20 time: 0.376972 Jan 24 09:17:55.335224 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 60/136] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:17:54 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1411 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 09:17:55.431985 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-11c4a2eb-eb17-4c31-9cd8-3035a54b65d3 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eacf11b5ea94c6386577eca24696b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cb3477628042869ffe08048f0a8ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:55.448857 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-11c4a2eb-eb17-4c31-9cd8-3035a54b65d3 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] 10.222.0.113 "GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d" status: 200 len: 1319 microversion: 2.1 time: 0.322273 Jan 24 09:17:55.451247 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 77/137] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:55 2022] GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d => generated 1319 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:17:55.559459 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-4218f2b0-49c8-4492-8929-8e6b8443101d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:55.559687 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-4218f2b0-49c8-4492-8929-8e6b8443101d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:55.566005 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4218f2b0-49c8-4492-8929-8e6b8443101d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:55.566644 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4218f2b0-49c8-4492-8929-8e6b8443101d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:55.567437 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4218f2b0-49c8-4492-8929-8e6b8443101d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:55.567961 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4218f2b0-49c8-4492-8929-8e6b8443101d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:55.735708 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [req-6acc3d5c-eb98-4112-9256-1fc9fa58488c req-679a4699-0ad8-4de3-8cba-b603c2994ef6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "047cd9d3-84f2-4cb0-a2ff-1439420b4f84", "name": "network-vif-plugged", "status": "completed", "tag": "8921ac36-ed44-4666-b756-63bd8f08a955"}]} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:17:55.742457 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:17:55.742457 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: warnings.warn(msg) Jan 24 09:17:55.749319 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-6acc3d5c-eb98-4112-9256-1fc9fa58488c req-679a4699-0ad8-4de3-8cba-b603c2994ef6 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:55.750127 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-6acc3d5c-eb98-4112-9256-1fc9fa58488c req-679a4699-0ad8-4de3-8cba-b603c2994ef6 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:55.765713 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.compute.server_external_events [req-6acc3d5c-eb98-4112-9256-1fc9fa58488c req-679a4699-0ad8-4de3-8cba-b603c2994ef6 service nova] Creating event network-vif-plugged:8921ac36-ed44-4666-b756-63bd8f08a955 for instance 047cd9d3-84f2-4cb0-a2ff-1439420b4f84 on hv-cinder-80403 Jan 24 09:17:55.771784 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [req-6acc3d5c-eb98-4112-9256-1fc9fa58488c req-679a4699-0ad8-4de3-8cba-b603c2994ef6 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041469 Jan 24 09:17:55.777008 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 78/138] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:17:55.853028 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-c08e6b79-63cc-4bdd-9094-e34b0bdd5a16 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:55.855100 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-c08e6b79-63cc-4bdd-9094-e34b0bdd5a16 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:55.863826 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c08e6b79-63cc-4bdd-9094-e34b0bdd5a16 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:55.864538 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c08e6b79-63cc-4bdd-9094-e34b0bdd5a16 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:55.865496 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c08e6b79-63cc-4bdd-9094-e34b0bdd5a16 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:55.866007 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c08e6b79-63cc-4bdd-9094-e34b0bdd5a16 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:56.071494 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-c08e6b79-63cc-4bdd-9094-e34b0bdd5a16 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:56.083644 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-c08e6b79-63cc-4bdd-9094-e34b0bdd5a16 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1366 microversion: 2.1 time: 0.237926 Jan 24 09:17:56.088876 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 79/139] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:55 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:17:56.097680 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-2094747b-53fa-4321-806d-ed0cafd4363d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:56.097680 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-2094747b-53fa-4321-806d-ed0cafd4363d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 334e86b7-8556-46c7-aad6-e5b2af845691] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:56.106394 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2094747b-53fa-4321-806d-ed0cafd4363d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:56.106853 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2094747b-53fa-4321-806d-ed0cafd4363d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:56.107674 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2094747b-53fa-4321-806d-ed0cafd4363d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:56.108116 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2094747b-53fa-4321-806d-ed0cafd4363d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:56.161980 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-4218f2b0-49c8-4492-8929-8e6b8443101d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:56.175468 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-4218f2b0-49c8-4492-8929-8e6b8443101d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1325 microversion: 2.1 time: 0.620649 Jan 24 09:17:56.178482 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 61/140] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:55 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1325 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:56.353825 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-e9fac2c8-477c-4538-89e8-0106e75d6e6f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:56.354536 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-e9fac2c8-477c-4538-89e8-0106e75d6e6f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:56.366395 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e9fac2c8-477c-4538-89e8-0106e75d6e6f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:56.368054 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e9fac2c8-477c-4538-89e8-0106e75d6e6f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:56.368667 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e9fac2c8-477c-4538-89e8-0106e75d6e6f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:56.370454 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e9fac2c8-477c-4538-89e8-0106e75d6e6f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:56.380068 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-2094747b-53fa-4321-806d-ed0cafd4363d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:56.404401 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-2094747b-53fa-4321-806d-ed0cafd4363d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691" status: 200 len: 1322 microversion: 2.1 time: 0.314340 Jan 24 09:17:56.406814 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 80/141] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:56 2022] GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691 => generated 1322 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:56.470936 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-929592bc-373c-47af-bf32-348647a77d4a tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:56.472653 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-929592bc-373c-47af-bf32-348647a77d4a tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] [instance: 8f231864-55f5-469d-b015-721a0ddc5e3d] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:56.489433 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-929592bc-373c-47af-bf32-348647a77d4a tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:56.490316 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-929592bc-373c-47af-bf32-348647a77d4a tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:56.492097 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-929592bc-373c-47af-bf32-348647a77d4a tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:56.493126 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-929592bc-373c-47af-bf32-348647a77d4a tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:56.762522 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-929592bc-373c-47af-bf32-348647a77d4a tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eacf11b5ea94c6386577eca24696b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cb3477628042869ffe08048f0a8ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:56.780538 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-929592bc-373c-47af-bf32-348647a77d4a tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] 10.222.0.113 "GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d" status: 200 len: 1319 microversion: 2.1 time: 0.315953 Jan 24 09:17:56.800135 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 81/142] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:56 2022] GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d => generated 1319 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:56.920033 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-e9fac2c8-477c-4538-89e8-0106e75d6e6f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:56.928844 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-e9fac2c8-477c-4538-89e8-0106e75d6e6f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:56.930534 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-e9fac2c8-477c-4538-89e8-0106e75d6e6f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:56.931921 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-e9fac2c8-477c-4538-89e8-0106e75d6e6f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1411 microversion: 2.20 time: 0.582310 Jan 24 09:17:56.932469 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 62/143] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:17:56 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1411 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 09:17:57.101459 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-d416ab6c-3752-49fc-865f-4d9b705e652a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:57.102275 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-d416ab6c-3752-49fc-865f-4d9b705e652a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:57.110122 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d416ab6c-3752-49fc-865f-4d9b705e652a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:57.110649 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d416ab6c-3752-49fc-865f-4d9b705e652a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:57.111508 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d416ab6c-3752-49fc-865f-4d9b705e652a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:57.112491 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d416ab6c-3752-49fc-865f-4d9b705e652a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:57.198203 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-1a4bd854-d449-47d3-8937-259a31159552 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:57.199470 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-1a4bd854-d449-47d3-8937-259a31159552 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:57.206341 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1a4bd854-d449-47d3-8937-259a31159552 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:57.206892 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1a4bd854-d449-47d3-8937-259a31159552 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:57.207804 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1a4bd854-d449-47d3-8937-259a31159552 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:57.208321 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1a4bd854-d449-47d3-8937-259a31159552 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:57.298761 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-d416ab6c-3752-49fc-865f-4d9b705e652a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:57.306666 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-d416ab6c-3752-49fc-865f-4d9b705e652a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1366 microversion: 2.1 time: 0.209399 Jan 24 09:17:57.307251 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 82/144] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:57 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:57.415071 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-1a4bd854-d449-47d3-8937-259a31159552 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:57.423364 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-e4359653-fb29-4ce4-a87b-bfdb706322eb tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:57.424147 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-e4359653-fb29-4ce4-a87b-bfdb706322eb tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 334e86b7-8556-46c7-aad6-e5b2af845691] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:57.426276 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-1a4bd854-d449-47d3-8937-259a31159552 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1325 microversion: 2.1 time: 0.231381 Jan 24 09:17:57.431495 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e4359653-fb29-4ce4-a87b-bfdb706322eb tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:57.432052 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e4359653-fb29-4ce4-a87b-bfdb706322eb tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:57.432417 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 63/145] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:57 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1325 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:17:57.432859 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e4359653-fb29-4ce4-a87b-bfdb706322eb tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:57.433297 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e4359653-fb29-4ce4-a87b-bfdb706322eb tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:57.587246 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-e4359653-fb29-4ce4-a87b-bfdb706322eb tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:57.594471 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-e4359653-fb29-4ce4-a87b-bfdb706322eb tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691" status: 200 len: 1322 microversion: 2.1 time: 0.174704 Jan 24 09:17:57.595050 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 83/146] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:57 2022] GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:17:57.787336 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [req-92023dc0-32e2-4769-ae95-ec0b24aebb88 req-099015ac-9c7b-470e-ad1c-2c44e2e93e2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c90c156b-e532-4c87-b23c-3d4326e991bd", "name": "network-vif-plugged", "status": "completed", "tag": "5e0c4cdf-09d8-44d6-8bce-e6c6ed362462"}]} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:17:57.789550 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:17:57.789550 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: warnings.warn(msg) Jan 24 09:17:57.799260 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-92023dc0-32e2-4769-ae95-ec0b24aebb88 req-099015ac-9c7b-470e-ad1c-2c44e2e93e2a service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:57.799790 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-92023dc0-32e2-4769-ae95-ec0b24aebb88 req-099015ac-9c7b-470e-ad1c-2c44e2e93e2a service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:57.805394 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-59d9a297-60cd-4cdc-90f1-47d8b946905a tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:57.806246 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-59d9a297-60cd-4cdc-90f1-47d8b946905a tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] [instance: 8f231864-55f5-469d-b015-721a0ddc5e3d] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:57.813010 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-59d9a297-60cd-4cdc-90f1-47d8b946905a tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:57.813461 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-59d9a297-60cd-4cdc-90f1-47d8b946905a tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:57.814493 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-59d9a297-60cd-4cdc-90f1-47d8b946905a tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:57.814939 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-59d9a297-60cd-4cdc-90f1-47d8b946905a tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:57.821258 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.compute.server_external_events [req-92023dc0-32e2-4769-ae95-ec0b24aebb88 req-099015ac-9c7b-470e-ad1c-2c44e2e93e2a service nova] Creating event network-vif-plugged:5e0c4cdf-09d8-44d6-8bce-e6c6ed362462 for instance c90c156b-e532-4c87-b23c-3d4326e991bd on hv-cinder-80403 Jan 24 09:17:57.821796 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-92023dc0-32e2-4769-ae95-ec0b24aebb88 req-099015ac-9c7b-470e-ad1c-2c44e2e93e2a service nova] Acquired lock "compute-rpcapi-router" {{(pid=116863) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 24 09:17:57.822948 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-045c5bdf-537b-4603-abb4-832b1b1b0249 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:57.823395 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-045c5bdf-537b-4603-abb4-832b1b1b0249 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:57.824412 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-045c5bdf-537b-4603-abb4-832b1b1b0249 None None] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:57.824846 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-045c5bdf-537b-4603-abb4-832b1b1b0249 None None] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:57.834634 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.compute.rpcapi [None req-045c5bdf-537b-4603-abb4-832b1b1b0249 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 24 09:17:57.835531 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-045c5bdf-537b-4603-abb4-832b1b1b0249 None None] Releasing lock "compute-rpcapi-router" {{(pid=116863) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 24 09:17:57.867588 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-045c5bdf-537b-4603-abb4-832b1b1b0249 None None] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084609 Jan 24 09:17:57.868519 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 64/147] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:17:57.950955 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-02b6b6e8-a1a9-415c-92a2-36d4cb08b3f4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:57.952098 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-02b6b6e8-a1a9-415c-92a2-36d4cb08b3f4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:57.959166 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-02b6b6e8-a1a9-415c-92a2-36d4cb08b3f4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:57.959626 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-02b6b6e8-a1a9-415c-92a2-36d4cb08b3f4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:57.960690 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-02b6b6e8-a1a9-415c-92a2-36d4cb08b3f4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:57.961135 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-02b6b6e8-a1a9-415c-92a2-36d4cb08b3f4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:57.968880 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-59d9a297-60cd-4cdc-90f1-47d8b946905a tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eacf11b5ea94c6386577eca24696b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cb3477628042869ffe08048f0a8ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:57.976580 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-59d9a297-60cd-4cdc-90f1-47d8b946905a tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] 10.222.0.113 "GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d" status: 200 len: 1319 microversion: 2.1 time: 0.174694 Jan 24 09:17:57.977163 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 84/148] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:57 2022] GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:17:58.117675 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-02b6b6e8-a1a9-415c-92a2-36d4cb08b3f4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:58.125827 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-02b6b6e8-a1a9-415c-92a2-36d4cb08b3f4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:58.127360 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-02b6b6e8-a1a9-415c-92a2-36d4cb08b3f4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:58.128616 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-02b6b6e8-a1a9-415c-92a2-36d4cb08b3f4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1411 microversion: 2.20 time: 0.181728 Jan 24 09:17:58.129176 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 65/149] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:17:57 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1411 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:17:58.332686 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-2ecb6d09-6632-44bb-ba7c-1cecdb2601c9 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:58.333272 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-2ecb6d09-6632-44bb-ba7c-1cecdb2601c9 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:58.339109 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2ecb6d09-6632-44bb-ba7c-1cecdb2601c9 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:58.339563 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2ecb6d09-6632-44bb-ba7c-1cecdb2601c9 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:58.340342 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2ecb6d09-6632-44bb-ba7c-1cecdb2601c9 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:58.340782 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2ecb6d09-6632-44bb-ba7c-1cecdb2601c9 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:58.451272 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-ab6201de-14d1-44ec-9151-81e1342b1428 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:58.451969 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-ab6201de-14d1-44ec-9151-81e1342b1428 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:58.459187 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ab6201de-14d1-44ec-9151-81e1342b1428 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:58.459646 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ab6201de-14d1-44ec-9151-81e1342b1428 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:58.460433 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ab6201de-14d1-44ec-9151-81e1342b1428 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:58.460879 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ab6201de-14d1-44ec-9151-81e1342b1428 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:58.522489 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-2ecb6d09-6632-44bb-ba7c-1cecdb2601c9 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:58.532644 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-2ecb6d09-6632-44bb-ba7c-1cecdb2601c9 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1366 microversion: 2.1 time: 0.204360 Jan 24 09:17:58.533301 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 85/150] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:58 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:58.593136 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-ab6201de-14d1-44ec-9151-81e1342b1428 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:58.599906 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-ab6201de-14d1-44ec-9151-81e1342b1428 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1325 microversion: 2.1 time: 0.159920 Jan 24 09:17:58.600474 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 66/151] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:58 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1325 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:17:58.611374 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-4bcb6757-77ce-41d9-90cf-7d549d5cd629 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:58.611984 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-4bcb6757-77ce-41d9-90cf-7d549d5cd629 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 334e86b7-8556-46c7-aad6-e5b2af845691] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:58.618941 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4bcb6757-77ce-41d9-90cf-7d549d5cd629 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:58.619418 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4bcb6757-77ce-41d9-90cf-7d549d5cd629 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:58.621552 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4bcb6757-77ce-41d9-90cf-7d549d5cd629 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:58.621552 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4bcb6757-77ce-41d9-90cf-7d549d5cd629 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:58.755947 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-4bcb6757-77ce-41d9-90cf-7d549d5cd629 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:58.763212 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-4bcb6757-77ce-41d9-90cf-7d549d5cd629 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691" status: 200 len: 1322 microversion: 2.1 time: 0.155584 Jan 24 09:17:58.763781 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 86/152] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:58 2022] GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:58.993124 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-22d0ecae-8d9a-4b87-acaf-4b51e81532e9 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:58.993727 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-22d0ecae-8d9a-4b87-acaf-4b51e81532e9 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] [instance: 8f231864-55f5-469d-b015-721a0ddc5e3d] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:58.999656 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-22d0ecae-8d9a-4b87-acaf-4b51e81532e9 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:59.000108 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-22d0ecae-8d9a-4b87-acaf-4b51e81532e9 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:59.000880 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-22d0ecae-8d9a-4b87-acaf-4b51e81532e9 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:59.001389 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-22d0ecae-8d9a-4b87-acaf-4b51e81532e9 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:59.141899 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-22d0ecae-8d9a-4b87-acaf-4b51e81532e9 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eacf11b5ea94c6386577eca24696b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cb3477628042869ffe08048f0a8ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:59.146877 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-06f52136-0b2c-4a89-93cf-0e977c95fc67 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:59.147705 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-06f52136-0b2c-4a89-93cf-0e977c95fc67 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:59.149958 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-22d0ecae-8d9a-4b87-acaf-4b51e81532e9 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] 10.222.0.113 "GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d" status: 200 len: 1319 microversion: 2.1 time: 0.160467 Jan 24 09:17:59.150755 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 67/153] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:58 2022] GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:59.153961 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-06f52136-0b2c-4a89-93cf-0e977c95fc67 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:59.154451 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-06f52136-0b2c-4a89-93cf-0e977c95fc67 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:59.155234 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-06f52136-0b2c-4a89-93cf-0e977c95fc67 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:59.155672 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-06f52136-0b2c-4a89-93cf-0e977c95fc67 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:59.288910 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-06f52136-0b2c-4a89-93cf-0e977c95fc67 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:59.295600 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-06f52136-0b2c-4a89-93cf-0e977c95fc67 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:59.297089 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-06f52136-0b2c-4a89-93cf-0e977c95fc67 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:59.298203 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-06f52136-0b2c-4a89-93cf-0e977c95fc67 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1411 microversion: 2.20 time: 0.155478 Jan 24 09:17:59.298915 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 87/154] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:17:59 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1411 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:17:59.549633 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-410b75cc-86ca-4bc2-9ac0-28472967805e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:59.550802 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-410b75cc-86ca-4bc2-9ac0-28472967805e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:59.557143 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-410b75cc-86ca-4bc2-9ac0-28472967805e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:59.557586 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-410b75cc-86ca-4bc2-9ac0-28472967805e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:59.558398 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-410b75cc-86ca-4bc2-9ac0-28472967805e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:59.558845 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-410b75cc-86ca-4bc2-9ac0-28472967805e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:59.617031 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-a0f5847d-6824-4a81-8f18-47e58211edfb tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:59.617732 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-a0f5847d-6824-4a81-8f18-47e58211edfb tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:59.623639 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a0f5847d-6824-4a81-8f18-47e58211edfb tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:59.624164 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a0f5847d-6824-4a81-8f18-47e58211edfb tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:59.624929 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a0f5847d-6824-4a81-8f18-47e58211edfb tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:59.625360 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a0f5847d-6824-4a81-8f18-47e58211edfb tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:59.699644 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-410b75cc-86ca-4bc2-9ac0-28472967805e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:59.710590 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-410b75cc-86ca-4bc2-9ac0-28472967805e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1366 microversion: 2.1 time: 0.164310 Jan 24 09:17:59.711156 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 68/155] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:59 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:17:59.779710 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-0b992b11-7c60-4fae-a86a-8c07ae7e359d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:17:59.785599 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-a0f5847d-6824-4a81-8f18-47e58211edfb tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:59.785756 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-0b992b11-7c60-4fae-a86a-8c07ae7e359d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 334e86b7-8556-46c7-aad6-e5b2af845691] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:17:59.786546 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0b992b11-7c60-4fae-a86a-8c07ae7e359d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:59.786988 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0b992b11-7c60-4fae-a86a-8c07ae7e359d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:59.787622 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-a0f5847d-6824-4a81-8f18-47e58211edfb tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1325 microversion: 2.1 time: 0.174981 Jan 24 09:17:59.787796 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0b992b11-7c60-4fae-a86a-8c07ae7e359d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:17:59.788224 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 88/156] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:59 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1325 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:17:59.788365 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0b992b11-7c60-4fae-a86a-8c07ae7e359d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:17:59.949500 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-0b992b11-7c60-4fae-a86a-8c07ae7e359d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:17:59.957809 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-0b992b11-7c60-4fae-a86a-8c07ae7e359d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691" status: 200 len: 1322 microversion: 2.1 time: 0.181465 Jan 24 09:17:59.962541 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 69/157] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:17:59 2022] GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:00.167929 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-3a97ff05-b4a3-4a24-a765-64e45cf19516 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:00.168532 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-3a97ff05-b4a3-4a24-a765-64e45cf19516 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] [instance: 8f231864-55f5-469d-b015-721a0ddc5e3d] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:00.179518 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3a97ff05-b4a3-4a24-a765-64e45cf19516 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:00.180899 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3a97ff05-b4a3-4a24-a765-64e45cf19516 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:00.181827 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3a97ff05-b4a3-4a24-a765-64e45cf19516 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:00.182293 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3a97ff05-b4a3-4a24-a765-64e45cf19516 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:00.317261 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-29775103-dd7c-459e-9f51-db69fa951dd4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:00.318314 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-29775103-dd7c-459e-9f51-db69fa951dd4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:00.324984 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-29775103-dd7c-459e-9f51-db69fa951dd4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:00.325768 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-29775103-dd7c-459e-9f51-db69fa951dd4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:00.326659 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-29775103-dd7c-459e-9f51-db69fa951dd4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:00.327236 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-29775103-dd7c-459e-9f51-db69fa951dd4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:00.369275 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-3a97ff05-b4a3-4a24-a765-64e45cf19516 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eacf11b5ea94c6386577eca24696b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cb3477628042869ffe08048f0a8ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:00.383482 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-3a97ff05-b4a3-4a24-a765-64e45cf19516 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] 10.222.0.113 "GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d" status: 200 len: 1319 microversion: 2.1 time: 0.218747 Jan 24 09:18:00.384529 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 89/158] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:00 2022] GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:00.543197 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-29775103-dd7c-459e-9f51-db69fa951dd4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:00.551658 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-29775103-dd7c-459e-9f51-db69fa951dd4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:00.553245 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-29775103-dd7c-459e-9f51-db69fa951dd4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:00.554302 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-29775103-dd7c-459e-9f51-db69fa951dd4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1411 microversion: 2.20 time: 0.241341 Jan 24 09:18:00.554864 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 70/159] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:18:00 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1411 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:18:00.727275 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-7ffddde9-15e3-4ce2-85d1-f7b25793abcd tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:00.727793 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-7ffddde9-15e3-4ce2-85d1-f7b25793abcd tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:00.734161 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-7ffddde9-15e3-4ce2-85d1-f7b25793abcd tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:00.734613 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-7ffddde9-15e3-4ce2-85d1-f7b25793abcd tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:00.737346 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-7ffddde9-15e3-4ce2-85d1-f7b25793abcd tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:00.737346 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-7ffddde9-15e3-4ce2-85d1-f7b25793abcd tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:00.804670 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-e2bd4c3d-8fc6-46d6-813f-809ef6062554 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:00.805285 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-e2bd4c3d-8fc6-46d6-813f-809ef6062554 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:00.817190 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e2bd4c3d-8fc6-46d6-813f-809ef6062554 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:00.817647 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e2bd4c3d-8fc6-46d6-813f-809ef6062554 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:00.818793 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e2bd4c3d-8fc6-46d6-813f-809ef6062554 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:00.819425 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e2bd4c3d-8fc6-46d6-813f-809ef6062554 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:00.892027 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-7ffddde9-15e3-4ce2-85d1-f7b25793abcd tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:00.908169 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-7ffddde9-15e3-4ce2-85d1-f7b25793abcd tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1366 microversion: 2.1 time: 0.184536 Jan 24 09:18:00.910875 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 90/160] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:00 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:00.978793 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-38aa3d20-02d1-464c-8799-561fdc8e7104 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:00.979539 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-38aa3d20-02d1-464c-8799-561fdc8e7104 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 334e86b7-8556-46c7-aad6-e5b2af845691] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:00.985362 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-38aa3d20-02d1-464c-8799-561fdc8e7104 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:00.985868 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-38aa3d20-02d1-464c-8799-561fdc8e7104 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:00.986817 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-38aa3d20-02d1-464c-8799-561fdc8e7104 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:00.987516 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-38aa3d20-02d1-464c-8799-561fdc8e7104 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:01.059927 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-e2bd4c3d-8fc6-46d6-813f-809ef6062554 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:01.071229 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-e2bd4c3d-8fc6-46d6-813f-809ef6062554 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1325 microversion: 2.1 time: 0.270452 Jan 24 09:18:01.073294 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 71/161] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:00 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1325 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:01.125446 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-38aa3d20-02d1-464c-8799-561fdc8e7104 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:01.133820 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-38aa3d20-02d1-464c-8799-561fdc8e7104 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691" status: 200 len: 1512 microversion: 2.1 time: 0.158751 Jan 24 09:18:01.134791 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 91/162] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:00 2022] GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691 => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:18:01.402781 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-97d6a0ac-2ce7-4c7d-818f-754e08cc75e8 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:01.403350 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-97d6a0ac-2ce7-4c7d-818f-754e08cc75e8 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] [instance: 8f231864-55f5-469d-b015-721a0ddc5e3d] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:01.409737 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-97d6a0ac-2ce7-4c7d-818f-754e08cc75e8 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:01.410441 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-97d6a0ac-2ce7-4c7d-818f-754e08cc75e8 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:01.411218 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-97d6a0ac-2ce7-4c7d-818f-754e08cc75e8 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:01.411703 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-97d6a0ac-2ce7-4c7d-818f-754e08cc75e8 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:01.550808 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-97d6a0ac-2ce7-4c7d-818f-754e08cc75e8 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eacf11b5ea94c6386577eca24696b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cb3477628042869ffe08048f0a8ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:01.558724 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-97d6a0ac-2ce7-4c7d-818f-754e08cc75e8 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] 10.222.0.113 "GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d" status: 200 len: 1505 microversion: 2.1 time: 0.159666 Jan 24 09:18:01.560411 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 72/163] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:01 2022] GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d => generated 1505 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:01.575297 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-84d2851f-5448-4faf-a508-6fd9365c21d8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:01.576110 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-84d2851f-5448-4faf-a508-6fd9365c21d8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:01.583454 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-84d2851f-5448-4faf-a508-6fd9365c21d8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:01.584170 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-84d2851f-5448-4faf-a508-6fd9365c21d8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:01.585028 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-84d2851f-5448-4faf-a508-6fd9365c21d8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:01.585539 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-84d2851f-5448-4faf-a508-6fd9365c21d8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:01.778873 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-84d2851f-5448-4faf-a508-6fd9365c21d8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:01.791762 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-84d2851f-5448-4faf-a508-6fd9365c21d8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:01.797094 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-84d2851f-5448-4faf-a508-6fd9365c21d8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:01.798572 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-84d2851f-5448-4faf-a508-6fd9365c21d8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1411 microversion: 2.20 time: 0.229418 Jan 24 09:18:01.799311 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 92/164] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:18:01 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1411 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:18:01.932592 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-0e2d59ba-a216-46a5-a8b9-f88507b60d90 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:01.934297 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-0e2d59ba-a216-46a5-a8b9-f88507b60d90 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:01.950739 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0e2d59ba-a216-46a5-a8b9-f88507b60d90 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:01.951543 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0e2d59ba-a216-46a5-a8b9-f88507b60d90 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:01.952561 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0e2d59ba-a216-46a5-a8b9-f88507b60d90 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:01.953200 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0e2d59ba-a216-46a5-a8b9-f88507b60d90 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:02.089922 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-a608568a-b944-4e3d-9af0-3f10b3e30d66 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:02.090923 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-a608568a-b944-4e3d-9af0-3f10b3e30d66 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:02.105006 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a608568a-b944-4e3d-9af0-3f10b3e30d66 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:02.105655 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a608568a-b944-4e3d-9af0-3f10b3e30d66 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:02.111931 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a608568a-b944-4e3d-9af0-3f10b3e30d66 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:02.112789 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a608568a-b944-4e3d-9af0-3f10b3e30d66 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:02.254580 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-0e2d59ba-a216-46a5-a8b9-f88507b60d90 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:02.263670 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-0e2d59ba-a216-46a5-a8b9-f88507b60d90 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1366 microversion: 2.1 time: 0.336883 Jan 24 09:18:02.264925 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 73/165] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:01 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1366 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:02.375129 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-a608568a-b944-4e3d-9af0-3f10b3e30d66 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:02.383490 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-a608568a-b944-4e3d-9af0-3f10b3e30d66 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1325 microversion: 2.1 time: 0.298919 Jan 24 09:18:02.384071 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 93/166] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:02 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1325 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:18:02.460494 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [req-9ef6f61d-7530-48a3-bb51-307bef7c4be6 req-e0c00bfc-d977-4a29-87e3-70874dc8f52f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b820c156-179a-4172-a02b-6c88713087f1", "name": "network-vif-plugged", "status": "completed", "tag": "73ec9bcf-7f40-4fd5-9968-de1accae6f03"}]} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:02.462267 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:18:02.462267 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: warnings.warn(msg) Jan 24 09:18:02.469162 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-9ef6f61d-7530-48a3-bb51-307bef7c4be6 req-e0c00bfc-d977-4a29-87e3-70874dc8f52f service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:02.469626 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-9ef6f61d-7530-48a3-bb51-307bef7c4be6 req-e0c00bfc-d977-4a29-87e3-70874dc8f52f service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:02.480465 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.compute.server_external_events [req-9ef6f61d-7530-48a3-bb51-307bef7c4be6 req-e0c00bfc-d977-4a29-87e3-70874dc8f52f service nova] Creating event network-vif-plugged:73ec9bcf-7f40-4fd5-9968-de1accae6f03 for instance b820c156-179a-4172-a02b-6c88713087f1 on hv-cinder-80403 Jan 24 09:18:02.485449 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [req-9ef6f61d-7530-48a3-bb51-307bef7c4be6 req-e0c00bfc-d977-4a29-87e3-70874dc8f52f service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028710 Jan 24 09:18:02.486028 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 74/167] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:18:02.820153 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-0e6968f0-4441-4951-91ba-96dfdfea1b5a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:02.821572 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-0e6968f0-4441-4951-91ba-96dfdfea1b5a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:02.830816 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0e6968f0-4441-4951-91ba-96dfdfea1b5a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:02.832225 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0e6968f0-4441-4951-91ba-96dfdfea1b5a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:02.833613 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0e6968f0-4441-4951-91ba-96dfdfea1b5a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:02.834236 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0e6968f0-4441-4951-91ba-96dfdfea1b5a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:02.971095 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-0e6968f0-4441-4951-91ba-96dfdfea1b5a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:02.978871 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-0e6968f0-4441-4951-91ba-96dfdfea1b5a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:02.980381 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-0e6968f0-4441-4951-91ba-96dfdfea1b5a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:02.981487 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-0e6968f0-4441-4951-91ba-96dfdfea1b5a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1411 microversion: 2.20 time: 0.166533 Jan 24 09:18:02.982049 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 94/168] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:18:02 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1411 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:18:03.285578 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-3d459e96-e5a1-4bde-a5f4-f34292d75bbe tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:03.286436 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-3d459e96-e5a1-4bde-a5f4-f34292d75bbe tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:03.293387 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3d459e96-e5a1-4bde-a5f4-f34292d75bbe tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:03.293847 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3d459e96-e5a1-4bde-a5f4-f34292d75bbe tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:03.294673 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3d459e96-e5a1-4bde-a5f4-f34292d75bbe tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:03.295112 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3d459e96-e5a1-4bde-a5f4-f34292d75bbe tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:03.400576 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-f409d640-d338-4756-b056-767280d0eb5e tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:03.401292 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-f409d640-d338-4756-b056-767280d0eb5e tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:03.407389 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f409d640-d338-4756-b056-767280d0eb5e tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:03.407844 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f409d640-d338-4756-b056-767280d0eb5e tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:03.409238 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f409d640-d338-4756-b056-767280d0eb5e tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:03.410431 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f409d640-d338-4756-b056-767280d0eb5e tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:03.441310 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-3d459e96-e5a1-4bde-a5f4-f34292d75bbe tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:03.454985 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-3d459e96-e5a1-4bde-a5f4-f34292d75bbe tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1366 microversion: 2.1 time: 0.175107 Jan 24 09:18:03.455582 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 75/169] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:03 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:03.541537 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-f409d640-d338-4756-b056-767280d0eb5e tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:03.548880 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-f409d640-d338-4756-b056-767280d0eb5e tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1519 microversion: 2.1 time: 0.151978 Jan 24 09:18:03.549443 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 95/170] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:03 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:18:03.566034 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-4dfabfbc-718d-49f7-b83d-0195efb5f001 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:03.567236 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-4dfabfbc-718d-49f7-b83d-0195efb5f001 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:03.573038 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4dfabfbc-718d-49f7-b83d-0195efb5f001 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:03.573423 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4dfabfbc-718d-49f7-b83d-0195efb5f001 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:03.574708 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4dfabfbc-718d-49f7-b83d-0195efb5f001 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:03.575134 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4dfabfbc-718d-49f7-b83d-0195efb5f001 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:03.641028 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.objects.instance [None req-4dfabfbc-718d-49f7-b83d-0195efb5f001 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lazy-loading 'flavor' on Instance uuid c90c156b-e532-4c87-b23c-3d4326e991bd {{(pid=116863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 09:18:04.000299 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-a130d0cd-8679-482c-82e7-80e392c27f03 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:04.000910 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-a130d0cd-8679-482c-82e7-80e392c27f03 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:04.012667 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a130d0cd-8679-482c-82e7-80e392c27f03 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:04.013118 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a130d0cd-8679-482c-82e7-80e392c27f03 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:04.014235 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a130d0cd-8679-482c-82e7-80e392c27f03 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:04.014828 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a130d0cd-8679-482c-82e7-80e392c27f03 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:04.125283 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-4dfabfbc-718d-49f7-b83d-0195efb5f001 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "POST /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd/action" status: 200 len: 32 microversion: 2.1 time: 0.563356 Jan 24 09:18:04.126148 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 76/171] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:18:03 2022] POST /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd/action => generated 32 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 09:18:04.146803 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-047f1f1b-371b-41c1-a69f-3100327dd701 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:04.153104 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-047f1f1b-371b-41c1-a69f-3100327dd701 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:04.164106 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-047f1f1b-371b-41c1-a69f-3100327dd701 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:04.164728 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-047f1f1b-371b-41c1-a69f-3100327dd701 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:04.165629 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-047f1f1b-371b-41c1-a69f-3100327dd701 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:04.166349 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-047f1f1b-371b-41c1-a69f-3100327dd701 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:04.181715 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-a130d0cd-8679-482c-82e7-80e392c27f03 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:04.192368 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-a130d0cd-8679-482c-82e7-80e392c27f03 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:04.195237 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-a130d0cd-8679-482c-82e7-80e392c27f03 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:04.196819 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-a130d0cd-8679-482c-82e7-80e392c27f03 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1411 microversion: 2.20 time: 0.200097 Jan 24 09:18:04.197817 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 96/172] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:18:03 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1411 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 09:18:04.304841 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-472a1467-d70e-4e7a-aef2-dbab18632d0b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "263ee709-32cb-4613-9bcd-15fee6bb01ff"}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:04.306770 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-472a1467-d70e-4e7a-aef2-dbab18632d0b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 334e86b7-8556-46c7-aad6-e5b2af845691] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:04.316016 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-472a1467-d70e-4e7a-aef2-dbab18632d0b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:04.316016 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-472a1467-d70e-4e7a-aef2-dbab18632d0b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:04.316016 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-472a1467-d70e-4e7a-aef2-dbab18632d0b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:04.316016 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-472a1467-d70e-4e7a-aef2-dbab18632d0b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:04.454295 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-047f1f1b-371b-41c1-a69f-3100327dd701 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:04.472355 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-047f1f1b-371b-41c1-a69f-3100327dd701 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1525 microversion: 2.1 time: 0.340460 Jan 24 09:18:04.473637 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 77/173] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:04 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1525 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:04.478056 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-0f7e4bd1-9ec5-44c2-a515-3a85114b621a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:04.478680 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-0f7e4bd1-9ec5-44c2-a515-3a85114b621a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:04.494779 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0f7e4bd1-9ec5-44c2-a515-3a85114b621a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:04.495234 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0f7e4bd1-9ec5-44c2-a515-3a85114b621a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:04.496209 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0f7e4bd1-9ec5-44c2-a515-3a85114b621a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:04.496801 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0f7e4bd1-9ec5-44c2-a515-3a85114b621a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:04.733200 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-0f7e4bd1-9ec5-44c2-a515-3a85114b621a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:04.749681 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-0f7e4bd1-9ec5-44c2-a515-3a85114b621a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1366 microversion: 2.1 time: 0.274825 Jan 24 09:18:04.750344 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 78/174] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:04 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1366 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:04.756823 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [req-fe2b983f-ae4a-4812-a28c-578436cf5f32 req-9247f11c-4d98-4b74-875f-a4ce626de7f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7421454-e5c9-4ecb-8afb-928a7042b789", "name": "network-vif-plugged", "status": "completed", "tag": "93c2fd64-23e2-4383-a6ab-b95fd9eca7df"}]} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:04.759062 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:18:04.759062 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: warnings.warn(msg) Jan 24 09:18:04.767032 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-fe2b983f-ae4a-4812-a28c-578436cf5f32 req-9247f11c-4d98-4b74-875f-a4ce626de7f5 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:04.767539 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-fe2b983f-ae4a-4812-a28c-578436cf5f32 req-9247f11c-4d98-4b74-875f-a4ce626de7f5 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:04.780308 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.compute.server_external_events [req-fe2b983f-ae4a-4812-a28c-578436cf5f32 req-9247f11c-4d98-4b74-875f-a4ce626de7f5 service nova] Creating event network-vif-plugged:93c2fd64-23e2-4383-a6ab-b95fd9eca7df for instance c7421454-e5c9-4ecb-8afb-928a7042b789 on hv-cinder-80403 Jan 24 09:18:04.786715 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [req-fe2b983f-ae4a-4812-a28c-578436cf5f32 req-9247f11c-4d98-4b74-875f-a4ce626de7f5 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034540 Jan 24 09:18:04.787394 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 79/175] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:18:04.970647 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-6705e329-2496-494b-afd0-add098caef08 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "68c64c2f-cf13-4dc8-b8a9-5e39a788b4e6"}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:04.975641 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-6705e329-2496-494b-afd0-add098caef08 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] [instance: 8f231864-55f5-469d-b015-721a0ddc5e3d] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:04.978763 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6705e329-2496-494b-afd0-add098caef08 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:04.979215 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6705e329-2496-494b-afd0-add098caef08 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:04.979990 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6705e329-2496-494b-afd0-add098caef08 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:04.980430 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6705e329-2496-494b-afd0-add098caef08 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:08.588292 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-472a1467-d70e-4e7a-aef2-dbab18632d0b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "POST /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.289731 Jan 24 09:18:08.593693 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 97/176] 10.222.0.113 () {60 vars in 1327 bytes} [Mon Jan 24 09:18:04 2022] POST /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691/os-volume_attachments => generated 194 bytes in 4292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:18:08.594088 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-dc8d6d8b-44f1-4d75-af3a-02e9da14324b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:08.594948 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-dc8d6d8b-44f1-4d75-af3a-02e9da14324b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:08.602388 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-dc8d6d8b-44f1-4d75-af3a-02e9da14324b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:08.602913 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-dc8d6d8b-44f1-4d75-af3a-02e9da14324b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:08.603789 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-dc8d6d8b-44f1-4d75-af3a-02e9da14324b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:08.604248 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-dc8d6d8b-44f1-4d75-af3a-02e9da14324b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:08.726595 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-6705e329-2496-494b-afd0-add098caef08 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] 10.222.0.113 "POST /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.759800 Jan 24 09:18:08.727240 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 80/177] 10.222.0.113 () {60 vars in 1327 bytes} [Mon Jan 24 09:18:04 2022] POST /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d/os-volume_attachments => generated 194 bytes in 3762 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 09:18:08.732667 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-3c8b90de-affa-4ac3-b4b8-efcad581ac93 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:08.733765 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-3c8b90de-affa-4ac3-b4b8-efcad581ac93 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:08.756318 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3c8b90de-affa-4ac3-b4b8-efcad581ac93 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:08.756663 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3c8b90de-affa-4ac3-b4b8-efcad581ac93 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:08.759028 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3c8b90de-affa-4ac3-b4b8-efcad581ac93 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:08.759028 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3c8b90de-affa-4ac3-b4b8-efcad581ac93 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:08.901459 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-3c8b90de-affa-4ac3-b4b8-efcad581ac93 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:08.912706 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-3c8b90de-affa-4ac3-b4b8-efcad581ac93 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1525 microversion: 2.1 time: 0.184236 Jan 24 09:18:08.913268 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 81/178] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:08 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1525 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:08.919611 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-67f412f5-db88-46db-9c8b-26f8298a77da tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:08.920587 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-67f412f5-db88-46db-9c8b-26f8298a77da tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:08.933570 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-67f412f5-db88-46db-9c8b-26f8298a77da tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:08.933570 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-67f412f5-db88-46db-9c8b-26f8298a77da tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:08.933570 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-67f412f5-db88-46db-9c8b-26f8298a77da tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:08.933570 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-67f412f5-db88-46db-9c8b-26f8298a77da tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:08.942604 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-dc8d6d8b-44f1-4d75-af3a-02e9da14324b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:08.958240 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-dc8d6d8b-44f1-4d75-af3a-02e9da14324b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:08.958240 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-dc8d6d8b-44f1-4d75-af3a-02e9da14324b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:08.958240 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-dc8d6d8b-44f1-4d75-af3a-02e9da14324b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1411 microversion: 2.20 time: 0.364399 Jan 24 09:18:08.958545 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 98/179] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:18:08 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1411 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:18:09.080495 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-67f412f5-db88-46db-9c8b-26f8298a77da tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:09.088089 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-67f412f5-db88-46db-9c8b-26f8298a77da tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1366 microversion: 2.1 time: 0.173838 Jan 24 09:18:09.088665 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 82/180] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:08 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:09.938165 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-1ad6824f-5166-4fda-afd4-a0a583126c4a tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:09.938165 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-1ad6824f-5166-4fda-afd4-a0a583126c4a tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:09.938165 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1ad6824f-5166-4fda-afd4-a0a583126c4a tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:09.938165 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1ad6824f-5166-4fda-afd4-a0a583126c4a tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:09.938809 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1ad6824f-5166-4fda-afd4-a0a583126c4a tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:09.938809 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1ad6824f-5166-4fda-afd4-a0a583126c4a tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:09.972759 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-e8bd5b3a-f207-4af4-8796-fde750054a4c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:09.973365 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-e8bd5b3a-f207-4af4-8796-fde750054a4c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:09.985313 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e8bd5b3a-f207-4af4-8796-fde750054a4c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:09.985313 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e8bd5b3a-f207-4af4-8796-fde750054a4c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:09.985313 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e8bd5b3a-f207-4af4-8796-fde750054a4c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:09.985313 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e8bd5b3a-f207-4af4-8796-fde750054a4c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:10.083014 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-1ad6824f-5166-4fda-afd4-a0a583126c4a tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:10.092367 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-1ad6824f-5166-4fda-afd4-a0a583126c4a tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1525 microversion: 2.1 time: 0.167354 Jan 24 09:18:10.092954 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 99/181] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:09 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1525 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:18:10.106463 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-9d349de1-40ce-4236-bd30-d49c6b4d9d5f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:10.106954 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-9d349de1-40ce-4236-bd30-d49c6b4d9d5f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:10.114229 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-9d349de1-40ce-4236-bd30-d49c6b4d9d5f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:10.115064 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-9d349de1-40ce-4236-bd30-d49c6b4d9d5f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:10.115719 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-9d349de1-40ce-4236-bd30-d49c6b4d9d5f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:10.116231 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-9d349de1-40ce-4236-bd30-d49c6b4d9d5f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:10.141644 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-e8bd5b3a-f207-4af4-8796-fde750054a4c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:10.150687 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-e8bd5b3a-f207-4af4-8796-fde750054a4c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:10.152221 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-e8bd5b3a-f207-4af4-8796-fde750054a4c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:10.154394 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-e8bd5b3a-f207-4af4-8796-fde750054a4c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1602 microversion: 2.20 time: 0.185424 Jan 24 09:18:10.154965 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 83/182] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:18:09 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1602 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 09:18:10.172815 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-755aad33-1258-458c-bb3b-a211c055a49c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:10.175264 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-755aad33-1258-458c-bb3b-a211c055a49c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:10.181283 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-755aad33-1258-458c-bb3b-a211c055a49c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:10.181731 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-755aad33-1258-458c-bb3b-a211c055a49c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:10.182568 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-755aad33-1258-458c-bb3b-a211c055a49c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:10.183003 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-755aad33-1258-458c-bb3b-a211c055a49c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:10.257864 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-9d349de1-40ce-4236-bd30-d49c6b4d9d5f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:10.265294 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-9d349de1-40ce-4236-bd30-d49c6b4d9d5f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1366 microversion: 2.1 time: 0.164080 Jan 24 09:18:10.270448 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 100/183] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:10 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:10.278016 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-755aad33-1258-458c-bb3b-a211c055a49c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.109130 Jan 24 09:18:10.278639 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 84/184] 10.222.0.113 () {60 vars in 1320 bytes} [Mon Jan 24 09:18:10 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 09:18:11.110534 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-05b80e54-d3ae-45cf-804f-2f6b40484501 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:11.111142 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-05b80e54-d3ae-45cf-804f-2f6b40484501 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:11.117960 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-05b80e54-d3ae-45cf-804f-2f6b40484501 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:11.118443 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-05b80e54-d3ae-45cf-804f-2f6b40484501 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:11.119223 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-05b80e54-d3ae-45cf-804f-2f6b40484501 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:11.119667 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-05b80e54-d3ae-45cf-804f-2f6b40484501 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:11.283282 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-d0ec8fe9-a4d4-4f9d-af6a-363dec5ea732 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:11.284477 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-d0ec8fe9-a4d4-4f9d-af6a-363dec5ea732 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:11.291056 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d0ec8fe9-a4d4-4f9d-af6a-363dec5ea732 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:11.292220 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d0ec8fe9-a4d4-4f9d-af6a-363dec5ea732 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:11.293060 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d0ec8fe9-a4d4-4f9d-af6a-363dec5ea732 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:11.293512 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d0ec8fe9-a4d4-4f9d-af6a-363dec5ea732 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:11.401799 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-05b80e54-d3ae-45cf-804f-2f6b40484501 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:11.409739 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-05b80e54-d3ae-45cf-804f-2f6b40484501 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1525 microversion: 2.1 time: 0.302831 Jan 24 09:18:11.410985 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 101/185] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:11 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1525 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:11.438942 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-d0ec8fe9-a4d4-4f9d-af6a-363dec5ea732 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:11.449235 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-d0ec8fe9-a4d4-4f9d-af6a-363dec5ea732 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1551 microversion: 2.1 time: 0.169891 Jan 24 09:18:11.449908 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 85/186] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:11 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1551 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:18:11.466472 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-5746e84b-971d-4395-8029-738a09a8c2c7 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:11.467181 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-5746e84b-971d-4395-8029-738a09a8c2c7 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:11.473188 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5746e84b-971d-4395-8029-738a09a8c2c7 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:11.473649 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5746e84b-971d-4395-8029-738a09a8c2c7 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:11.478421 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5746e84b-971d-4395-8029-738a09a8c2c7 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:11.478421 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5746e84b-971d-4395-8029-738a09a8c2c7 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:11.770498 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-5746e84b-971d-4395-8029-738a09a8c2c7 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.307610 Jan 24 09:18:11.771201 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 102/187] 10.222.0.113 () {58 vars in 1279 bytes} [Mon Jan 24 09:18:11 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/os-interface => generated 284 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:18:11.918209 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-389e055b-fca6-44f4-91d7-3f558f6c4cfb tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:11.923427 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [req-8cf5a973-4acb-4ebd-ab5c-3502015bcac9 req-283047cd-c788-4794-8a63-efd1065f83aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b820c156-179a-4172-a02b-6c88713087f1", "tag": "73ec9bcf-7f40-4fd5-9968-de1accae6f03"}]} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:11.925751 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:18:11.925751 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: warnings.warn(msg) Jan 24 09:18:11.929758 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-389e055b-fca6-44f4-91d7-3f558f6c4cfb tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:11.948154 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-389e055b-fca6-44f4-91d7-3f558f6c4cfb tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:11.948602 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-389e055b-fca6-44f4-91d7-3f558f6c4cfb tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:11.949390 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-389e055b-fca6-44f4-91d7-3f558f6c4cfb tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:11.949820 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-389e055b-fca6-44f4-91d7-3f558f6c4cfb tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:11.953176 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-8cf5a973-4acb-4ebd-ab5c-3502015bcac9 req-283047cd-c788-4794-8a63-efd1065f83aa service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:11.953708 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-8cf5a973-4acb-4ebd-ab5c-3502015bcac9 req-283047cd-c788-4794-8a63-efd1065f83aa service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:11.997394 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.compute.server_external_events [req-8cf5a973-4acb-4ebd-ab5c-3502015bcac9 req-283047cd-c788-4794-8a63-efd1065f83aa service nova] Creating event network-changed:73ec9bcf-7f40-4fd5-9968-de1accae6f03 for instance b820c156-179a-4172-a02b-6c88713087f1 on hv-cinder-80403 Jan 24 09:18:12.006442 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [req-8cf5a973-4acb-4ebd-ab5c-3502015bcac9 req-283047cd-c788-4794-8a63-efd1065f83aa service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085398 Jan 24 09:18:12.006442 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 103/188] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:18:12.059146 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-389e055b-fca6-44f4-91d7-3f558f6c4cfb tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 14 microversion: 2.20 time: 0.142366 Jan 24 09:18:12.063594 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 86/189] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:18:11 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 14 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:12.428605 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-68ab892d-f13d-470d-a375-518e03e19215 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:12.429317 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-68ab892d-f13d-470d-a375-518e03e19215 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:12.439000 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-68ab892d-f13d-470d-a375-518e03e19215 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:12.442379 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-68ab892d-f13d-470d-a375-518e03e19215 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:12.442379 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-68ab892d-f13d-470d-a375-518e03e19215 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:12.442379 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-68ab892d-f13d-470d-a375-518e03e19215 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:12.614448 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-68ab892d-f13d-470d-a375-518e03e19215 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:12.622126 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-68ab892d-f13d-470d-a375-518e03e19215 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1525 microversion: 2.1 time: 0.198737 Jan 24 09:18:12.623300 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 104/190] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:12 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1525 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:13.071063 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-030f0e52-23d4-4004-862c-c164810c969d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:13.072283 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-030f0e52-23d4-4004-862c-c164810c969d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:13.083657 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-030f0e52-23d4-4004-862c-c164810c969d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:13.084114 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-030f0e52-23d4-4004-862c-c164810c969d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:13.084916 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-030f0e52-23d4-4004-862c-c164810c969d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:13.089572 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-030f0e52-23d4-4004-862c-c164810c969d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:13.220943 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-030f0e52-23d4-4004-862c-c164810c969d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 14 microversion: 2.20 time: 0.153354 Jan 24 09:18:13.222943 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 87/191] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:18:13 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 14 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:13.639695 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-e3365d73-ffdf-49bd-a19d-5c3fd7130c6c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:13.640379 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-e3365d73-ffdf-49bd-a19d-5c3fd7130c6c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:13.647006 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e3365d73-ffdf-49bd-a19d-5c3fd7130c6c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:13.647457 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e3365d73-ffdf-49bd-a19d-5c3fd7130c6c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:13.648484 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e3365d73-ffdf-49bd-a19d-5c3fd7130c6c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:13.649059 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e3365d73-ffdf-49bd-a19d-5c3fd7130c6c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:13.804841 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-65911adc-f23b-4d34-ad05-b1bdb3f1bba5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:13.807069 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-e3365d73-ffdf-49bd-a19d-5c3fd7130c6c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:13.807480 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-65911adc-f23b-4d34-ad05-b1bdb3f1bba5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:13.816160 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-e3365d73-ffdf-49bd-a19d-5c3fd7130c6c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1525 microversion: 2.1 time: 0.179579 Jan 24 09:18:13.816831 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 105/192] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:13 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1525 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:13.825501 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [req-e64410b1-67cd-4960-aeb1-179350cffa88 req-97ddce8f-004e-41f2-95f6-831b64f7e2a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7421454-e5c9-4ecb-8afb-928a7042b789", "tag": "93c2fd64-23e2-4383-a6ab-b95fd9eca7df"}]} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:13.825501 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:18:13.825501 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: warnings.warn(msg) Jan 24 09:18:13.827310 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-65911adc-f23b-4d34-ad05-b1bdb3f1bba5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:13.827310 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-65911adc-f23b-4d34-ad05-b1bdb3f1bba5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:13.827866 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-65911adc-f23b-4d34-ad05-b1bdb3f1bba5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:13.828442 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-65911adc-f23b-4d34-ad05-b1bdb3f1bba5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:13.832238 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-e64410b1-67cd-4960-aeb1-179350cffa88 req-97ddce8f-004e-41f2-95f6-831b64f7e2a9 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:13.832770 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-e64410b1-67cd-4960-aeb1-179350cffa88 req-97ddce8f-004e-41f2-95f6-831b64f7e2a9 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:13.857271 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.compute.server_external_events [req-e64410b1-67cd-4960-aeb1-179350cffa88 req-97ddce8f-004e-41f2-95f6-831b64f7e2a9 service nova] Creating event network-changed:93c2fd64-23e2-4383-a6ab-b95fd9eca7df for instance c7421454-e5c9-4ecb-8afb-928a7042b789 on hv-cinder-80403 Jan 24 09:18:13.859489 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [req-e64410b1-67cd-4960-aeb1-179350cffa88 req-97ddce8f-004e-41f2-95f6-831b64f7e2a9 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041288 Jan 24 09:18:13.863948 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 106/193] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:18:14.105620 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-65911adc-f23b-4d34-ad05-b1bdb3f1bba5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 14 microversion: 2.1 time: 0.306153 Jan 24 09:18:14.106588 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 88/194] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:18:13 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 14 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 24 09:18:14.244706 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-a27f8899-d4ea-4c0a-8a0e-9bad51cfb03a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:14.245735 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-a27f8899-d4ea-4c0a-8a0e-9bad51cfb03a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:14.253600 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a27f8899-d4ea-4c0a-8a0e-9bad51cfb03a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:14.254279 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a27f8899-d4ea-4c0a-8a0e-9bad51cfb03a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:14.257494 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a27f8899-d4ea-4c0a-8a0e-9bad51cfb03a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:14.264967 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a27f8899-d4ea-4c0a-8a0e-9bad51cfb03a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:14.375835 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-a27f8899-d4ea-4c0a-8a0e-9bad51cfb03a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 14 microversion: 2.20 time: 0.144147 Jan 24 09:18:14.377039 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 107/195] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:18:14 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:14.834417 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-ec5f19b6-aafe-4734-94d9-3ef6e9a42d8c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:14.835201 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-ec5f19b6-aafe-4734-94d9-3ef6e9a42d8c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:14.842235 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ec5f19b6-aafe-4734-94d9-3ef6e9a42d8c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:14.842804 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ec5f19b6-aafe-4734-94d9-3ef6e9a42d8c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:14.844043 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ec5f19b6-aafe-4734-94d9-3ef6e9a42d8c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:14.844553 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ec5f19b6-aafe-4734-94d9-3ef6e9a42d8c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:15.046774 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-ec5f19b6-aafe-4734-94d9-3ef6e9a42d8c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:15.066324 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-ec5f19b6-aafe-4734-94d9-3ef6e9a42d8c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1525 microversion: 2.1 time: 0.236603 Jan 24 09:18:15.072704 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 89/196] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:14 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1525 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:15.117528 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-63f121f5-1cb0-480c-a781-cc72060f7e6b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:15.119052 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-63f121f5-1cb0-480c-a781-cc72060f7e6b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:15.154948 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-63f121f5-1cb0-480c-a781-cc72060f7e6b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:15.155407 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-63f121f5-1cb0-480c-a781-cc72060f7e6b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:15.156219 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-63f121f5-1cb0-480c-a781-cc72060f7e6b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:15.156662 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-63f121f5-1cb0-480c-a781-cc72060f7e6b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:15.265914 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-63f121f5-1cb0-480c-a781-cc72060f7e6b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 14 microversion: 2.1 time: 0.151556 Jan 24 09:18:15.266572 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 108/197] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:18:15 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 14 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 09:18:15.401599 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-a157e555-2488-45c0-8193-85edf4112900 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:15.402651 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-a157e555-2488-45c0-8193-85edf4112900 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:15.409938 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a157e555-2488-45c0-8193-85edf4112900 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:15.410953 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a157e555-2488-45c0-8193-85edf4112900 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:15.413992 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a157e555-2488-45c0-8193-85edf4112900 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:15.413992 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a157e555-2488-45c0-8193-85edf4112900 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:15.533479 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-a157e555-2488-45c0-8193-85edf4112900 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 14 microversion: 2.20 time: 0.137584 Jan 24 09:18:15.535161 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 90/198] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:18:15 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:16.084147 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-1213d19a-5f94-49a9-bc22-1d250bd380b7 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:16.084765 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-1213d19a-5f94-49a9-bc22-1d250bd380b7 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:16.091881 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1213d19a-5f94-49a9-bc22-1d250bd380b7 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:16.092341 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1213d19a-5f94-49a9-bc22-1d250bd380b7 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:16.093121 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1213d19a-5f94-49a9-bc22-1d250bd380b7 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:16.093635 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1213d19a-5f94-49a9-bc22-1d250bd380b7 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:16.277674 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-cac89a58-3482-4d68-ba51-ba03dd3d6de8 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:16.278848 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-cac89a58-3482-4d68-ba51-ba03dd3d6de8 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:16.286374 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-cac89a58-3482-4d68-ba51-ba03dd3d6de8 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:16.286830 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-cac89a58-3482-4d68-ba51-ba03dd3d6de8 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:16.287618 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-cac89a58-3482-4d68-ba51-ba03dd3d6de8 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:16.288168 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-cac89a58-3482-4d68-ba51-ba03dd3d6de8 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:16.367493 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-cac89a58-3482-4d68-ba51-ba03dd3d6de8 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 14 microversion: 2.1 time: 0.093747 Jan 24 09:18:16.368125 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 91/199] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:18:16 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 09:18:16.379106 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-1213d19a-5f94-49a9-bc22-1d250bd380b7 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:16.386897 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-1213d19a-5f94-49a9-bc22-1d250bd380b7 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1525 microversion: 2.1 time: 0.306906 Jan 24 09:18:16.387479 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 109/200] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:16 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1525 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:16.545451 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-064819a9-da53-4f34-8d6b-ccfd1147ea7a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:16.546476 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-064819a9-da53-4f34-8d6b-ccfd1147ea7a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:16.554879 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-064819a9-da53-4f34-8d6b-ccfd1147ea7a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:16.555583 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-064819a9-da53-4f34-8d6b-ccfd1147ea7a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:16.556844 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-064819a9-da53-4f34-8d6b-ccfd1147ea7a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:16.557277 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-064819a9-da53-4f34-8d6b-ccfd1147ea7a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:16.630615 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-064819a9-da53-4f34-8d6b-ccfd1147ea7a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 14 microversion: 2.20 time: 0.089258 Jan 24 09:18:16.633800 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 92/201] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:18:16 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:17.379307 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-42d1dd60-7581-411f-b0ef-427e028ae442 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:17.380905 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-42d1dd60-7581-411f-b0ef-427e028ae442 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:17.387792 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-42d1dd60-7581-411f-b0ef-427e028ae442 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:17.388329 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-42d1dd60-7581-411f-b0ef-427e028ae442 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:17.389125 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-42d1dd60-7581-411f-b0ef-427e028ae442 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:17.389563 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-42d1dd60-7581-411f-b0ef-427e028ae442 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:17.406025 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-0c3d5f2c-3a6e-424d-9ae0-448956658e28 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:17.406888 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-0c3d5f2c-3a6e-424d-9ae0-448956658e28 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:17.418214 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0c3d5f2c-3a6e-424d-9ae0-448956658e28 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:17.418762 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0c3d5f2c-3a6e-424d-9ae0-448956658e28 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:17.419765 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0c3d5f2c-3a6e-424d-9ae0-448956658e28 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:17.420268 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0c3d5f2c-3a6e-424d-9ae0-448956658e28 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:17.484226 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-42d1dd60-7581-411f-b0ef-427e028ae442 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 14 microversion: 2.1 time: 0.109198 Jan 24 09:18:17.484865 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 110/202] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:18:17 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 09:18:17.567898 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-0c3d5f2c-3a6e-424d-9ae0-448956658e28 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:17.575460 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-0c3d5f2c-3a6e-424d-9ae0-448956658e28 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1525 microversion: 2.1 time: 0.174655 Jan 24 09:18:17.576976 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 93/203] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:17 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1525 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:18:17.641338 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-82049306-bf9e-485e-81d3-03de128ab165 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:17.642312 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-82049306-bf9e-485e-81d3-03de128ab165 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:17.649608 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-82049306-bf9e-485e-81d3-03de128ab165 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:17.650063 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-82049306-bf9e-485e-81d3-03de128ab165 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:17.650889 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-82049306-bf9e-485e-81d3-03de128ab165 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:17.651326 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-82049306-bf9e-485e-81d3-03de128ab165 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:17.760308 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-82049306-bf9e-485e-81d3-03de128ab165 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 14 microversion: 2.20 time: 0.122932 Jan 24 09:18:17.763467 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 111/204] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:18:17 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:18.495603 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-f2680cd4-3aa2-4f89-be98-94fe373852df tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:18.496764 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-f2680cd4-3aa2-4f89-be98-94fe373852df tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:18.502957 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f2680cd4-3aa2-4f89-be98-94fe373852df tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:18.503480 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f2680cd4-3aa2-4f89-be98-94fe373852df tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:18.504249 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f2680cd4-3aa2-4f89-be98-94fe373852df tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:18.504677 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f2680cd4-3aa2-4f89-be98-94fe373852df tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:18.592900 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-153ee7ec-7a9a-412c-a3a1-bcdca86ed8d5 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:18.593577 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-153ee7ec-7a9a-412c-a3a1-bcdca86ed8d5 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:18.601255 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-153ee7ec-7a9a-412c-a3a1-bcdca86ed8d5 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:18.601702 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-153ee7ec-7a9a-412c-a3a1-bcdca86ed8d5 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:18.602609 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-153ee7ec-7a9a-412c-a3a1-bcdca86ed8d5 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:18.603067 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-153ee7ec-7a9a-412c-a3a1-bcdca86ed8d5 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:18.752643 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-153ee7ec-7a9a-412c-a3a1-bcdca86ed8d5 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:18.760693 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-153ee7ec-7a9a-412c-a3a1-bcdca86ed8d5 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1525 microversion: 2.1 time: 0.171718 Jan 24 09:18:18.761275 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 112/205] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:18 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1525 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:18:18.774194 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-84d013cf-4cdd-45bc-8a4c-1960321147fd tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:18.775351 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-84d013cf-4cdd-45bc-8a4c-1960321147fd tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:18.781121 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-84d013cf-4cdd-45bc-8a4c-1960321147fd tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:18.781565 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-84d013cf-4cdd-45bc-8a4c-1960321147fd tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:18.782358 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-84d013cf-4cdd-45bc-8a4c-1960321147fd tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:18.782789 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-84d013cf-4cdd-45bc-8a4c-1960321147fd tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:21.395150 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-f2680cd4-3aa2-4f89-be98-94fe373852df tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 14 microversion: 2.1 time: 2.903094 Jan 24 09:18:21.395900 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 94/206] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:18:18 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 14 bytes in 2905 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 09:18:21.400666 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-7b7b6f5f-38a4-4418-b553-a36a7ba7bc7c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:21.401358 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-7b7b6f5f-38a4-4418-b553-a36a7ba7bc7c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:21.408143 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7b7b6f5f-38a4-4418-b553-a36a7ba7bc7c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:21.408755 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7b7b6f5f-38a4-4418-b553-a36a7ba7bc7c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:21.409714 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7b7b6f5f-38a4-4418-b553-a36a7ba7bc7c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:21.410177 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7b7b6f5f-38a4-4418-b553-a36a7ba7bc7c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:21.413580 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-84d013cf-4cdd-45bc-8a4c-1960321147fd tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 14 microversion: 2.20 time: 2.643025 Jan 24 09:18:21.414550 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 113/207] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:18:18 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 14 bytes in 2645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:21.552547 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-7b7b6f5f-38a4-4418-b553-a36a7ba7bc7c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:21.560058 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-7b7b6f5f-38a4-4418-b553-a36a7ba7bc7c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1525 microversion: 2.1 time: 0.163072 Jan 24 09:18:21.560699 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 95/208] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:21 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1525 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:22.406849 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-ebc99b8c-fcca-4563-85dd-5a646fc8e15f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:22.407884 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-ebc99b8c-fcca-4563-85dd-5a646fc8e15f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:22.415268 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ebc99b8c-fcca-4563-85dd-5a646fc8e15f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:22.415856 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ebc99b8c-fcca-4563-85dd-5a646fc8e15f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:22.416461 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ebc99b8c-fcca-4563-85dd-5a646fc8e15f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:22.416890 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ebc99b8c-fcca-4563-85dd-5a646fc8e15f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:22.424888 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-9977cf23-cea7-4177-9ff2-c60ac61c7a77 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:22.425818 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-9977cf23-cea7-4177-9ff2-c60ac61c7a77 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:22.432347 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9977cf23-cea7-4177-9ff2-c60ac61c7a77 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:22.432798 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9977cf23-cea7-4177-9ff2-c60ac61c7a77 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:22.433582 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9977cf23-cea7-4177-9ff2-c60ac61c7a77 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:22.434022 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9977cf23-cea7-4177-9ff2-c60ac61c7a77 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:22.531091 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-ebc99b8c-fcca-4563-85dd-5a646fc8e15f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 14 microversion: 2.1 time: 0.128106 Jan 24 09:18:22.531739 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 114/209] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:18:22 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 09:18:22.538518 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-9977cf23-cea7-4177-9ff2-c60ac61c7a77 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 14 microversion: 2.20 time: 0.117700 Jan 24 09:18:22.539343 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 96/210] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:18:22 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:22.577161 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-c18d1f55-cdd7-4328-9b57-ee9d5ba3c856 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:22.577805 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-c18d1f55-cdd7-4328-9b57-ee9d5ba3c856 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:22.585875 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c18d1f55-cdd7-4328-9b57-ee9d5ba3c856 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:22.586358 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c18d1f55-cdd7-4328-9b57-ee9d5ba3c856 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:22.587153 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c18d1f55-cdd7-4328-9b57-ee9d5ba3c856 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:22.587597 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c18d1f55-cdd7-4328-9b57-ee9d5ba3c856 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:22.721667 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-c18d1f55-cdd7-4328-9b57-ee9d5ba3c856 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:22.728875 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-c18d1f55-cdd7-4328-9b57-ee9d5ba3c856 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1525 microversion: 2.1 time: 0.156014 Jan 24 09:18:22.729443 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 115/211] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:22 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1525 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:23.272712 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-fbff0c4f-a375-4a9a-88d5-4d327cb87e83 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-243985245", "imageRef": "c527e37f-a381-465e-babe-11528029ed9b", "flavorRef": "452", "networks": [{"uuid": "595abfef-3114-4487-9adf-a62cd7425c5d"}]}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:23.324193 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.network.neutron [None req-fbff0c4f-a375-4a9a-88d5-4d327cb87e83 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] validate_networks() for [('595abfef-3114-4487-9adf-a62cd7425c5d', None, None, None, None, None)] {{(pid=116863) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 09:18:23.544365 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-697cf24b-4f59-484c-adc7-1b2221938b54 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:23.546018 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-697cf24b-4f59-484c-adc7-1b2221938b54 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:23.554252 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-697cf24b-4f59-484c-adc7-1b2221938b54 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:23.555443 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-697cf24b-4f59-484c-adc7-1b2221938b54 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:23.556241 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-697cf24b-4f59-484c-adc7-1b2221938b54 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:23.556959 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-697cf24b-4f59-484c-adc7-1b2221938b54 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:23.647602 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-697cf24b-4f59-484c-adc7-1b2221938b54 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 14 microversion: 2.1 time: 0.108581 Jan 24 09:18:23.650900 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 116/212] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:18:23 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 24 09:18:23.653476 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-efbd0773-91eb-46b3-80e0-e58acd5300f1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:23.654492 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-efbd0773-91eb-46b3-80e0-e58acd5300f1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:23.661433 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-efbd0773-91eb-46b3-80e0-e58acd5300f1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:23.661878 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-efbd0773-91eb-46b3-80e0-e58acd5300f1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:23.662673 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-efbd0773-91eb-46b3-80e0-e58acd5300f1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:23.663103 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-efbd0773-91eb-46b3-80e0-e58acd5300f1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:23.703469 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.virt.hardware [None req-fbff0c4f-a375-4a9a-88d5-4d327cb87e83 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Flavor limits 0:0:0 {{(pid=116863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 09:18:23.703979 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.virt.hardware [None req-fbff0c4f-a375-4a9a-88d5-4d327cb87e83 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Image limits 0:0:0 {{(pid=116863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 09:18:23.704375 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.virt.hardware [None req-fbff0c4f-a375-4a9a-88d5-4d327cb87e83 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Flavor pref 0:0:0 {{(pid=116863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 09:18:23.704826 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.virt.hardware [None req-fbff0c4f-a375-4a9a-88d5-4d327cb87e83 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Image pref 0:0:0 {{(pid=116863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 09:18:23.705857 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.virt.hardware [None req-fbff0c4f-a375-4a9a-88d5-4d327cb87e83 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 09:18:23.714593 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-fbff0c4f-a375-4a9a-88d5-4d327cb87e83 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:23.715034 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-fbff0c4f-a375-4a9a-88d5-4d327cb87e83 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:23.715838 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-fbff0c4f-a375-4a9a-88d5-4d327cb87e83 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:23.716268 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-fbff0c4f-a375-4a9a-88d5-4d327cb87e83 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:23.733320 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.quota [None req-fbff0c4f-a375-4a9a-88d5-4d327cb87e83 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Getting quotas for project 9effc220352541ecba9f319db87235de. Resources: {'ram', 'cores', 'instances'} {{(pid=116863) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 09:18:23.739058 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.quota [None req-fbff0c4f-a375-4a9a-88d5-4d327cb87e83 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Getting quotas for user 49d33f34357f4132b712dff54a6446f3 and project 9effc220352541ecba9f319db87235de. Resources: {'ram', 'cores', 'instances'} {{(pid=116863) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 09:18:23.749832 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-fbff0c4f-a375-4a9a-88d5-4d327cb87e83 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Going to run 1 instances... {{(pid=116863) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 09:18:23.752897 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-fbff0c4f-a375-4a9a-88d5-4d327cb87e83 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 6b0c5b63-d2d9-4dbd-b01d-845151d57d74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c527e37f-a381-465e-babe-11528029ed9b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 09:18:23.757237 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-efbd0773-91eb-46b3-80e0-e58acd5300f1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 14 microversion: 2.20 time: 0.107297 Jan 24 09:18:23.757921 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 117/213] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:18:23 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:23.762976 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-a8c33617-379e-4785-98f0-41d06f031202 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:23.763708 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-a8c33617-379e-4785-98f0-41d06f031202 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:23.771457 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a8c33617-379e-4785-98f0-41d06f031202 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:23.771931 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a8c33617-379e-4785-98f0-41d06f031202 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:23.772702 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a8c33617-379e-4785-98f0-41d06f031202 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:23.773142 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a8c33617-379e-4785-98f0-41d06f031202 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:23.877938 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-fbff0c4f-a375-4a9a-88d5-4d327cb87e83 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.608970 Jan 24 09:18:23.879293 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 97/214] 10.222.0.113 () {60 vars in 1151 bytes} [Mon Jan 24 09:18:23 2022] POST /compute/v2.1/servers => generated 382 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 24 09:18:23.890016 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-ce4e16bc-5b03-40d5-9137-8e47f7343d13 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:23.890677 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-ce4e16bc-5b03-40d5-9137-8e47f7343d13 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 6b0c5b63-d2d9-4dbd-b01d-845151d57d74] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:23.912938 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-a8c33617-379e-4785-98f0-41d06f031202 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:23.920499 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-a8c33617-379e-4785-98f0-41d06f031202 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1525 microversion: 2.1 time: 0.161437 Jan 24 09:18:23.921306 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 118/215] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:23 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1525 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:23.963650 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-ce4e16bc-5b03-40d5-9137-8e47f7343d13 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:23.971310 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-ce4e16bc-5b03-40d5-9137-8e47f7343d13 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/6b0c5b63-d2d9-4dbd-b01d-845151d57d74" status: 200 len: 1221 microversion: 2.1 time: 0.086186 Jan 24 09:18:23.972033 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 98/216] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:23 2022] GET /compute/v2.1/servers/6b0c5b63-d2d9-4dbd-b01d-845151d57d74 => generated 1221 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:18:24.658438 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-ce01530a-5b68-44d9-b028-2652b5c912c6 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:24.660313 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-ce01530a-5b68-44d9-b028-2652b5c912c6 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:24.666783 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ce01530a-5b68-44d9-b028-2652b5c912c6 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:24.668719 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ce01530a-5b68-44d9-b028-2652b5c912c6 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:24.668719 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ce01530a-5b68-44d9-b028-2652b5c912c6 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:24.668719 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ce01530a-5b68-44d9-b028-2652b5c912c6 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:24.769393 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-0aa9419b-a3ed-4fcd-adb7-e4d04efbf2bd tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:24.770655 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-0aa9419b-a3ed-4fcd-adb7-e4d04efbf2bd tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:24.771504 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-ce01530a-5b68-44d9-b028-2652b5c912c6 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 14 microversion: 2.1 time: 0.116689 Jan 24 09:18:24.772305 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 119/217] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:18:24 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 09:18:24.781733 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0aa9419b-a3ed-4fcd-adb7-e4d04efbf2bd tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:24.782222 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0aa9419b-a3ed-4fcd-adb7-e4d04efbf2bd tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:24.783030 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0aa9419b-a3ed-4fcd-adb7-e4d04efbf2bd tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:24.783980 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0aa9419b-a3ed-4fcd-adb7-e4d04efbf2bd tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:24.875347 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-0aa9419b-a3ed-4fcd-adb7-e4d04efbf2bd tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 14 microversion: 2.20 time: 0.110830 Jan 24 09:18:24.880070 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 99/218] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:18:24 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:18:24.939235 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-28982830-702d-4849-a604-0b19776a225d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:24.940086 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-28982830-702d-4849-a604-0b19776a225d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:24.947192 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-28982830-702d-4849-a604-0b19776a225d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:24.947638 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-28982830-702d-4849-a604-0b19776a225d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:24.948406 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-28982830-702d-4849-a604-0b19776a225d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:24.948838 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-28982830-702d-4849-a604-0b19776a225d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:25.011497 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-6ea4701f-8553-459e-9e01-a35feb2cf3e0 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:25.016113 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-6ea4701f-8553-459e-9e01-a35feb2cf3e0 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 6b0c5b63-d2d9-4dbd-b01d-845151d57d74] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:25.042086 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6ea4701f-8553-459e-9e01-a35feb2cf3e0 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:25.048187 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6ea4701f-8553-459e-9e01-a35feb2cf3e0 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:25.050310 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6ea4701f-8553-459e-9e01-a35feb2cf3e0 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:25.050855 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6ea4701f-8553-459e-9e01-a35feb2cf3e0 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:25.128627 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-6ea4701f-8553-459e-9e01-a35feb2cf3e0 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:25.139055 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-6ea4701f-8553-459e-9e01-a35feb2cf3e0 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/6b0c5b63-d2d9-4dbd-b01d-845151d57d74" status: 200 len: 1225 microversion: 2.1 time: 0.153002 Jan 24 09:18:25.140227 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 100/219] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:24 2022] GET /compute/v2.1/servers/6b0c5b63-d2d9-4dbd-b01d-845151d57d74 => generated 1225 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:25.183612 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-28982830-702d-4849-a604-0b19776a225d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:25.191694 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-28982830-702d-4849-a604-0b19776a225d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1525 microversion: 2.1 time: 0.256598 Jan 24 09:18:25.200894 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 120/220] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:24 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1525 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:25.784945 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-b9107d2b-307e-4ed0-b46e-a04e59ced21b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:25.786194 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-b9107d2b-307e-4ed0-b46e-a04e59ced21b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:25.795073 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b9107d2b-307e-4ed0-b46e-a04e59ced21b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:25.795537 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b9107d2b-307e-4ed0-b46e-a04e59ced21b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:25.796393 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b9107d2b-307e-4ed0-b46e-a04e59ced21b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:25.796842 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b9107d2b-307e-4ed0-b46e-a04e59ced21b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:25.887966 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-6c19b5a7-ab46-41f3-b54b-e79ec7b41085 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:25.888906 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-6c19b5a7-ab46-41f3-b54b-e79ec7b41085 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:25.896285 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6c19b5a7-ab46-41f3-b54b-e79ec7b41085 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:25.896761 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6c19b5a7-ab46-41f3-b54b-e79ec7b41085 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:25.897759 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6c19b5a7-ab46-41f3-b54b-e79ec7b41085 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:25.898058 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6c19b5a7-ab46-41f3-b54b-e79ec7b41085 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:25.899523 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-b9107d2b-307e-4ed0-b46e-a04e59ced21b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 14 microversion: 2.1 time: 0.119914 Jan 24 09:18:25.902821 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 101/221] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:18:25 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 09:18:26.019145 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-6c19b5a7-ab46-41f3-b54b-e79ec7b41085 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 14 microversion: 2.20 time: 0.133411 Jan 24 09:18:26.020028 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 121/222] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:18:25 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 14 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:26.158777 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-619e840e-ac3c-40cf-a020-3e0cfd2f66c7 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:26.159630 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-619e840e-ac3c-40cf-a020-3e0cfd2f66c7 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 6b0c5b63-d2d9-4dbd-b01d-845151d57d74] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:26.175834 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-619e840e-ac3c-40cf-a020-3e0cfd2f66c7 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:26.176291 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-619e840e-ac3c-40cf-a020-3e0cfd2f66c7 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:26.177201 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-619e840e-ac3c-40cf-a020-3e0cfd2f66c7 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:26.177643 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-619e840e-ac3c-40cf-a020-3e0cfd2f66c7 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:26.227268 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-1c25daa1-58b6-4dec-badf-bdbd2edf7117 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:26.228802 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-1c25daa1-58b6-4dec-badf-bdbd2edf7117 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:26.237385 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1c25daa1-58b6-4dec-badf-bdbd2edf7117 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:26.238150 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1c25daa1-58b6-4dec-badf-bdbd2edf7117 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:26.238943 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1c25daa1-58b6-4dec-badf-bdbd2edf7117 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:26.239416 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1c25daa1-58b6-4dec-badf-bdbd2edf7117 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:26.303326 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-619e840e-ac3c-40cf-a020-3e0cfd2f66c7 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:26.311030 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-619e840e-ac3c-40cf-a020-3e0cfd2f66c7 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/6b0c5b63-d2d9-4dbd-b01d-845151d57d74" status: 200 len: 1273 microversion: 2.1 time: 0.157839 Jan 24 09:18:26.311983 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 102/223] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:26 2022] GET /compute/v2.1/servers/6b0c5b63-d2d9-4dbd-b01d-845151d57d74 => generated 1273 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:26.436888 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-1c25daa1-58b6-4dec-badf-bdbd2edf7117 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:26.458627 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-1c25daa1-58b6-4dec-badf-bdbd2edf7117 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1525 microversion: 2.1 time: 0.251678 Jan 24 09:18:26.460000 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 122/224] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:26 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1525 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:26.911165 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-a7003473-8625-4658-a7d1-d07a19917b9a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:26.912088 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-a7003473-8625-4658-a7d1-d07a19917b9a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:26.918788 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a7003473-8625-4658-a7d1-d07a19917b9a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:26.919468 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a7003473-8625-4658-a7d1-d07a19917b9a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:26.920264 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a7003473-8625-4658-a7d1-d07a19917b9a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:26.920710 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a7003473-8625-4658-a7d1-d07a19917b9a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:27.030332 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-2eae604b-77d6-4ed5-99ae-dbcc52ba18ee tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:27.031362 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-2eae604b-77d6-4ed5-99ae-dbcc52ba18ee tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:27.038821 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2eae604b-77d6-4ed5-99ae-dbcc52ba18ee tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:27.039286 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2eae604b-77d6-4ed5-99ae-dbcc52ba18ee tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:27.040089 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2eae604b-77d6-4ed5-99ae-dbcc52ba18ee tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:27.040522 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2eae604b-77d6-4ed5-99ae-dbcc52ba18ee tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:27.047415 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-a7003473-8625-4658-a7d1-d07a19917b9a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 14 microversion: 2.1 time: 0.138670 Jan 24 09:18:27.048341 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 103/225] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:18:26 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 09:18:27.182495 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-2eae604b-77d6-4ed5-99ae-dbcc52ba18ee tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 14 microversion: 2.20 time: 0.155668 Jan 24 09:18:27.183137 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 123/226] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:18:27 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 14 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:27.329737 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-f591f4ed-fc5d-4564-a006-9d5983969c70 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:27.331159 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-f591f4ed-fc5d-4564-a006-9d5983969c70 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 6b0c5b63-d2d9-4dbd-b01d-845151d57d74] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:27.338529 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f591f4ed-fc5d-4564-a006-9d5983969c70 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:27.339213 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f591f4ed-fc5d-4564-a006-9d5983969c70 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:27.340114 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f591f4ed-fc5d-4564-a006-9d5983969c70 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:27.340661 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f591f4ed-fc5d-4564-a006-9d5983969c70 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:27.412266 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-f591f4ed-fc5d-4564-a006-9d5983969c70 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:27.419774 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-f591f4ed-fc5d-4564-a006-9d5983969c70 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/6b0c5b63-d2d9-4dbd-b01d-845151d57d74" status: 200 len: 1279 microversion: 2.1 time: 0.094705 Jan 24 09:18:27.420371 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 104/227] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:27 2022] GET /compute/v2.1/servers/6b0c5b63-d2d9-4dbd-b01d-845151d57d74 => generated 1279 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:27.476855 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-ce454c35-0167-40c9-a7fd-328eb64d4546 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:27.477594 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-ce454c35-0167-40c9-a7fd-328eb64d4546 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:27.484355 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ce454c35-0167-40c9-a7fd-328eb64d4546 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:27.484805 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ce454c35-0167-40c9-a7fd-328eb64d4546 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:27.485578 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ce454c35-0167-40c9-a7fd-328eb64d4546 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:27.486018 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ce454c35-0167-40c9-a7fd-328eb64d4546 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:27.640994 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-ce454c35-0167-40c9-a7fd-328eb64d4546 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:27.648840 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-ce454c35-0167-40c9-a7fd-328eb64d4546 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1525 microversion: 2.1 time: 0.175951 Jan 24 09:18:27.649673 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 124/228] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:27 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1525 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:28.060705 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-34c89fc3-28f1-4f27-b990-2d26e748dc0b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:28.062352 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-34c89fc3-28f1-4f27-b990-2d26e748dc0b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:28.072091 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-34c89fc3-28f1-4f27-b990-2d26e748dc0b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:28.072091 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-34c89fc3-28f1-4f27-b990-2d26e748dc0b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:28.072091 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-34c89fc3-28f1-4f27-b990-2d26e748dc0b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:28.072483 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-34c89fc3-28f1-4f27-b990-2d26e748dc0b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:28.170218 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-34c89fc3-28f1-4f27-b990-2d26e748dc0b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 14 microversion: 2.1 time: 0.114226 Jan 24 09:18:28.170858 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 105/229] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:18:28 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 09:18:28.193351 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-c04dd27f-ff45-4306-b03e-c9407e64aadf tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:28.194510 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-c04dd27f-ff45-4306-b03e-c9407e64aadf tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:28.201514 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c04dd27f-ff45-4306-b03e-c9407e64aadf tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:28.202260 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c04dd27f-ff45-4306-b03e-c9407e64aadf tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:28.203189 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c04dd27f-ff45-4306-b03e-c9407e64aadf tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:28.209677 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c04dd27f-ff45-4306-b03e-c9407e64aadf tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:28.304225 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-c04dd27f-ff45-4306-b03e-c9407e64aadf tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 14 microversion: 2.20 time: 0.114944 Jan 24 09:18:28.305803 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 125/230] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:18:28 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:28.445916 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-7ca14da2-440e-414a-91ed-5e10d1cb6e54 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:28.446139 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-7ca14da2-440e-414a-91ed-5e10d1cb6e54 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 6b0c5b63-d2d9-4dbd-b01d-845151d57d74] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:28.454171 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7ca14da2-440e-414a-91ed-5e10d1cb6e54 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:28.454171 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7ca14da2-440e-414a-91ed-5e10d1cb6e54 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:28.455296 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7ca14da2-440e-414a-91ed-5e10d1cb6e54 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:28.455981 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7ca14da2-440e-414a-91ed-5e10d1cb6e54 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:28.536698 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [req-67beb7a2-c59b-4938-bb49-17fc44672531 req-c37e7fed-247b-48e7-95e1-5dd37f0feb43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b0c5b63-d2d9-4dbd-b01d-845151d57d74", "tag": "37794bd0-f89a-4e6a-8e1c-c7c7ab98e3c5"}]} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:28.538412 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:18:28.538412 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: warnings.warn(msg) Jan 24 09:18:28.546546 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-67beb7a2-c59b-4938-bb49-17fc44672531 req-c37e7fed-247b-48e7-95e1-5dd37f0feb43 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:28.547236 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-67beb7a2-c59b-4938-bb49-17fc44672531 req-c37e7fed-247b-48e7-95e1-5dd37f0feb43 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:28.561638 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.compute.server_external_events [req-67beb7a2-c59b-4938-bb49-17fc44672531 req-c37e7fed-247b-48e7-95e1-5dd37f0feb43 service nova] Creating event network-changed:37794bd0-f89a-4e6a-8e1c-c7c7ab98e3c5 for instance 6b0c5b63-d2d9-4dbd-b01d-845151d57d74 on hv-cinder-80403 Jan 24 09:18:28.567440 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [req-67beb7a2-c59b-4938-bb49-17fc44672531 req-c37e7fed-247b-48e7-95e1-5dd37f0feb43 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035678 Jan 24 09:18:28.568509 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 126/231] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 09:18:28.668098 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-10aeeab4-4afc-49ee-b2ef-02f6efc70d07 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:28.668804 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-10aeeab4-4afc-49ee-b2ef-02f6efc70d07 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:28.676198 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-10aeeab4-4afc-49ee-b2ef-02f6efc70d07 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:28.676873 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-10aeeab4-4afc-49ee-b2ef-02f6efc70d07 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:28.677824 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-10aeeab4-4afc-49ee-b2ef-02f6efc70d07 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:28.678288 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-10aeeab4-4afc-49ee-b2ef-02f6efc70d07 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:28.739296 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-7ca14da2-440e-414a-91ed-5e10d1cb6e54 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:28.749411 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-7ca14da2-440e-414a-91ed-5e10d1cb6e54 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/6b0c5b63-d2d9-4dbd-b01d-845151d57d74" status: 200 len: 1321 microversion: 2.1 time: 0.313702 Jan 24 09:18:28.750999 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 106/232] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:28 2022] GET /compute/v2.1/servers/6b0c5b63-d2d9-4dbd-b01d-845151d57d74 => generated 1321 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:28.958161 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-10aeeab4-4afc-49ee-b2ef-02f6efc70d07 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:28.967080 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-10aeeab4-4afc-49ee-b2ef-02f6efc70d07 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1525 microversion: 2.1 time: 0.304163 Jan 24 09:18:28.968014 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 127/233] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:28 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1525 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:18:29.184187 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-75bfb2c7-46ea-4b7f-b889-063c778e2c92 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:29.185269 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-75bfb2c7-46ea-4b7f-b889-063c778e2c92 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:29.196649 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-75bfb2c7-46ea-4b7f-b889-063c778e2c92 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:29.199000 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-75bfb2c7-46ea-4b7f-b889-063c778e2c92 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:29.199873 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-75bfb2c7-46ea-4b7f-b889-063c778e2c92 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:29.200329 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-75bfb2c7-46ea-4b7f-b889-063c778e2c92 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:29.318185 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-75bfb2c7-46ea-4b7f-b889-063c778e2c92 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 14 microversion: 2.1 time: 0.138289 Jan 24 09:18:29.319712 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 107/234] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:18:29 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 09:18:29.321795 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-63f80f4c-cef3-4405-91e6-768a98382e82 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:29.322799 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-63f80f4c-cef3-4405-91e6-768a98382e82 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:29.339174 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-63f80f4c-cef3-4405-91e6-768a98382e82 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:29.339852 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-63f80f4c-cef3-4405-91e6-768a98382e82 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:29.340666 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-63f80f4c-cef3-4405-91e6-768a98382e82 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:29.341137 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-63f80f4c-cef3-4405-91e6-768a98382e82 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:29.430137 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-63f80f4c-cef3-4405-91e6-768a98382e82 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 14 microversion: 2.20 time: 0.117508 Jan 24 09:18:29.431004 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 128/235] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:18:29 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:18:29.770071 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-867d36a4-9cc9-4866-9e92-ca84108a2d0f tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:29.770968 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-867d36a4-9cc9-4866-9e92-ca84108a2d0f tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 6b0c5b63-d2d9-4dbd-b01d-845151d57d74] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:29.780779 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-867d36a4-9cc9-4866-9e92-ca84108a2d0f tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:29.781266 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-867d36a4-9cc9-4866-9e92-ca84108a2d0f tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:29.782067 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-867d36a4-9cc9-4866-9e92-ca84108a2d0f tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:29.783865 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-867d36a4-9cc9-4866-9e92-ca84108a2d0f tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:29.935527 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-867d36a4-9cc9-4866-9e92-ca84108a2d0f tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:29.943968 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-867d36a4-9cc9-4866-9e92-ca84108a2d0f tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/6b0c5b63-d2d9-4dbd-b01d-845151d57d74" status: 200 len: 1321 microversion: 2.1 time: 0.179306 Jan 24 09:18:29.944644 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 108/236] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:29 2022] GET /compute/v2.1/servers/6b0c5b63-d2d9-4dbd-b01d-845151d57d74 => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:29.985433 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-6bd2f7c9-ea2e-41b9-83fa-1a771648444a tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:29.986332 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-6bd2f7c9-ea2e-41b9-83fa-1a771648444a tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:29.993893 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6bd2f7c9-ea2e-41b9-83fa-1a771648444a tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:29.994442 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6bd2f7c9-ea2e-41b9-83fa-1a771648444a tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:29.995250 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6bd2f7c9-ea2e-41b9-83fa-1a771648444a tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:29.995697 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6bd2f7c9-ea2e-41b9-83fa-1a771648444a tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:30.294524 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-6bd2f7c9-ea2e-41b9-83fa-1a771648444a tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:30.294524 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-6bd2f7c9-ea2e-41b9-83fa-1a771648444a tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1525 microversion: 2.1 time: 0.261146 Jan 24 09:18:30.294524 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 129/237] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:29 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1525 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:30.327137 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-4386305c-b8ac-4203-94c7-f9c196c225b0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:30.335641 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-4386305c-b8ac-4203-94c7-f9c196c225b0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:30.335641 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4386305c-b8ac-4203-94c7-f9c196c225b0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:30.336197 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4386305c-b8ac-4203-94c7-f9c196c225b0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:30.336673 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4386305c-b8ac-4203-94c7-f9c196c225b0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:30.337108 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4386305c-b8ac-4203-94c7-f9c196c225b0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:30.501205 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-4386305c-b8ac-4203-94c7-f9c196c225b0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 14 microversion: 2.1 time: 0.100539 Jan 24 09:18:30.501205 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 109/238] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:18:30 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 09:18:30.501415 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-a1776350-c1ab-4bbf-bb3d-9681f99f97a8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:30.501415 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-a1776350-c1ab-4bbf-bb3d-9681f99f97a8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:30.501415 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a1776350-c1ab-4bbf-bb3d-9681f99f97a8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:30.501415 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a1776350-c1ab-4bbf-bb3d-9681f99f97a8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:30.502378 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a1776350-c1ab-4bbf-bb3d-9681f99f97a8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:30.502378 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a1776350-c1ab-4bbf-bb3d-9681f99f97a8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:30.574285 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-a1776350-c1ab-4bbf-bb3d-9681f99f97a8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 14 microversion: 2.20 time: 0.136506 Jan 24 09:18:30.574967 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 130/239] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:18:30 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:18:30.961481 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-72c184ab-04d2-4be6-9b44-923791c3fe3d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:30.962241 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-72c184ab-04d2-4be6-9b44-923791c3fe3d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 6b0c5b63-d2d9-4dbd-b01d-845151d57d74] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:30.969204 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-72c184ab-04d2-4be6-9b44-923791c3fe3d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:30.969660 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-72c184ab-04d2-4be6-9b44-923791c3fe3d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:30.970510 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-72c184ab-04d2-4be6-9b44-923791c3fe3d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:30.971044 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-72c184ab-04d2-4be6-9b44-923791c3fe3d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:31.117348 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-72c184ab-04d2-4be6-9b44-923791c3fe3d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:31.125071 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-72c184ab-04d2-4be6-9b44-923791c3fe3d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/6b0c5b63-d2d9-4dbd-b01d-845151d57d74" status: 200 len: 1321 microversion: 2.1 time: 0.167687 Jan 24 09:18:31.126091 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 110/240] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:30 2022] GET /compute/v2.1/servers/6b0c5b63-d2d9-4dbd-b01d-845151d57d74 => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:31.300746 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-6723de8e-c20e-497d-a45a-18967f791979 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:31.301385 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-6723de8e-c20e-497d-a45a-18967f791979 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:31.310892 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6723de8e-c20e-497d-a45a-18967f791979 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:31.311536 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6723de8e-c20e-497d-a45a-18967f791979 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:31.312438 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6723de8e-c20e-497d-a45a-18967f791979 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:31.313244 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6723de8e-c20e-497d-a45a-18967f791979 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:31.461482 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-6723de8e-c20e-497d-a45a-18967f791979 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:31.469867 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-6723de8e-c20e-497d-a45a-18967f791979 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1525 microversion: 2.1 time: 0.174013 Jan 24 09:18:31.470494 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 131/241] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:31 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1525 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:31.507968 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-7f9dc080-bc25-4f09-9cc6-7998b04ba685 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:31.508888 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-7f9dc080-bc25-4f09-9cc6-7998b04ba685 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:31.515122 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7f9dc080-bc25-4f09-9cc6-7998b04ba685 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:31.516641 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7f9dc080-bc25-4f09-9cc6-7998b04ba685 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:31.516641 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7f9dc080-bc25-4f09-9cc6-7998b04ba685 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:31.516829 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7f9dc080-bc25-4f09-9cc6-7998b04ba685 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:31.588618 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-f48af6ed-08ca-4b0a-baa9-ded07466377d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:31.589547 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-f48af6ed-08ca-4b0a-baa9-ded07466377d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:31.596284 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f48af6ed-08ca-4b0a-baa9-ded07466377d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:31.596757 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f48af6ed-08ca-4b0a-baa9-ded07466377d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:31.597553 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f48af6ed-08ca-4b0a-baa9-ded07466377d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:31.597986 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f48af6ed-08ca-4b0a-baa9-ded07466377d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:31.612595 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-7f9dc080-bc25-4f09-9cc6-7998b04ba685 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 14 microversion: 2.1 time: 0.106742 Jan 24 09:18:31.614144 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 111/242] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:18:31 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 09:18:31.651922 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-54042fc8-7211-4051-bd5e-47ac9b970e44 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:31.652776 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-54042fc8-7211-4051-bd5e-47ac9b970e44 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] [instance: 8f231864-55f5-469d-b015-721a0ddc5e3d] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:31.662090 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-54042fc8-7211-4051-bd5e-47ac9b970e44 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:31.667247 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-54042fc8-7211-4051-bd5e-47ac9b970e44 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:31.667247 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-54042fc8-7211-4051-bd5e-47ac9b970e44 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:31.667247 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-54042fc8-7211-4051-bd5e-47ac9b970e44 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:31.691059 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-54042fc8-7211-4051-bd5e-47ac9b970e44 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] [instance: 8f231864-55f5-469d-b015-721a0ddc5e3d] Going to try to terminate instance {{(pid=116863) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 09:18:31.729485 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-f48af6ed-08ca-4b0a-baa9-ded07466377d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 14 microversion: 2.20 time: 0.144229 Jan 24 09:18:31.730156 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 132/243] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:18:31 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 14 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:18:31.956331 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-54042fc8-7211-4051-bd5e-47ac9b970e44 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] 10.222.0.113 "DELETE /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d" status: 204 len: 0 microversion: 2.1 time: 0.307949 Jan 24 09:18:31.957225 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 112/244] 10.222.0.113 () {58 vars in 1243 bytes} [Mon Jan 24 09:18:31 2022] DELETE /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 24 09:18:31.974353 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-18c189b4-6ef1-4082-af99-12b0b64abede tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:31.975773 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-18c189b4-6ef1-4082-af99-12b0b64abede tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] [instance: 8f231864-55f5-469d-b015-721a0ddc5e3d] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:31.983423 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-18c189b4-6ef1-4082-af99-12b0b64abede tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:31.984125 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-18c189b4-6ef1-4082-af99-12b0b64abede tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:31.985131 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-18c189b4-6ef1-4082-af99-12b0b64abede tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:31.985647 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-18c189b4-6ef1-4082-af99-12b0b64abede tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:32.145898 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-646ef275-0857-43ad-b489-eb02b9f14e00 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:32.147376 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-646ef275-0857-43ad-b489-eb02b9f14e00 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 6b0c5b63-d2d9-4dbd-b01d-845151d57d74] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:32.154371 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-646ef275-0857-43ad-b489-eb02b9f14e00 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:32.154819 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-646ef275-0857-43ad-b489-eb02b9f14e00 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:32.155626 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-646ef275-0857-43ad-b489-eb02b9f14e00 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:32.156512 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-646ef275-0857-43ad-b489-eb02b9f14e00 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:32.195818 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-18c189b4-6ef1-4082-af99-12b0b64abede tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eacf11b5ea94c6386577eca24696b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cb3477628042869ffe08048f0a8ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:32.204207 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-18c189b4-6ef1-4082-af99-12b0b64abede tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] 10.222.0.113 "GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d" status: 200 len: 1557 microversion: 2.1 time: 0.235482 Jan 24 09:18:32.204827 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 133/245] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:31 2022] GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d => generated 1557 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:18:32.326256 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-646ef275-0857-43ad-b489-eb02b9f14e00 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:32.348080 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-646ef275-0857-43ad-b489-eb02b9f14e00 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/6b0c5b63-d2d9-4dbd-b01d-845151d57d74" status: 200 len: 1321 microversion: 2.1 time: 0.196700 Jan 24 09:18:32.348080 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 113/246] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:32 2022] GET /compute/v2.1/servers/6b0c5b63-d2d9-4dbd-b01d-845151d57d74 => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:32.487511 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-40b53653-07c7-4e35-a2e3-97daff6dcd0d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:32.488142 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-40b53653-07c7-4e35-a2e3-97daff6dcd0d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:32.495119 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-40b53653-07c7-4e35-a2e3-97daff6dcd0d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:32.495634 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-40b53653-07c7-4e35-a2e3-97daff6dcd0d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:32.496496 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-40b53653-07c7-4e35-a2e3-97daff6dcd0d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:32.497079 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-40b53653-07c7-4e35-a2e3-97daff6dcd0d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:32.625343 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-ec75d200-f5e9-4d6b-8b20-9f1b22c46dec tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:32.627020 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-ec75d200-f5e9-4d6b-8b20-9f1b22c46dec tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:32.634805 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ec75d200-f5e9-4d6b-8b20-9f1b22c46dec tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:32.636123 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ec75d200-f5e9-4d6b-8b20-9f1b22c46dec tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:32.637419 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ec75d200-f5e9-4d6b-8b20-9f1b22c46dec tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:32.638192 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ec75d200-f5e9-4d6b-8b20-9f1b22c46dec tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:32.654427 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-40b53653-07c7-4e35-a2e3-97daff6dcd0d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:32.667681 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-40b53653-07c7-4e35-a2e3-97daff6dcd0d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1525 microversion: 2.1 time: 0.184589 Jan 24 09:18:32.668459 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 134/247] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:32 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1525 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:32.740840 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-b3341127-2afd-42b1-80dd-8705c1ce60de tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:32.741820 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-b3341127-2afd-42b1-80dd-8705c1ce60de tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:32.748286 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b3341127-2afd-42b1-80dd-8705c1ce60de tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:32.748739 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b3341127-2afd-42b1-80dd-8705c1ce60de tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:32.749529 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b3341127-2afd-42b1-80dd-8705c1ce60de tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:32.749961 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b3341127-2afd-42b1-80dd-8705c1ce60de tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:32.760012 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-ec75d200-f5e9-4d6b-8b20-9f1b22c46dec tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 14 microversion: 2.1 time: 0.138570 Jan 24 09:18:32.761269 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 114/248] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:18:32 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 09:18:32.848740 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-b3341127-2afd-42b1-80dd-8705c1ce60de tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 14 microversion: 2.20 time: 0.111518 Jan 24 09:18:32.849510 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 135/249] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:18:32 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:18:33.223589 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-b11150fc-de89-46d9-a99a-b39355724033 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:33.224293 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-b11150fc-de89-46d9-a99a-b39355724033 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] [instance: 8f231864-55f5-469d-b015-721a0ddc5e3d] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:33.231509 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b11150fc-de89-46d9-a99a-b39355724033 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:33.232257 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b11150fc-de89-46d9-a99a-b39355724033 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:33.233045 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b11150fc-de89-46d9-a99a-b39355724033 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:33.233494 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b11150fc-de89-46d9-a99a-b39355724033 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:33.355400 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-91c7cb85-2e47-43d8-986a-74a7f8077189 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:33.356901 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-91c7cb85-2e47-43d8-986a-74a7f8077189 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 6b0c5b63-d2d9-4dbd-b01d-845151d57d74] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:33.365363 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-91c7cb85-2e47-43d8-986a-74a7f8077189 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:33.366048 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-91c7cb85-2e47-43d8-986a-74a7f8077189 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:33.367403 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-91c7cb85-2e47-43d8-986a-74a7f8077189 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:33.368605 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-91c7cb85-2e47-43d8-986a-74a7f8077189 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:33.386456 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-b11150fc-de89-46d9-a99a-b39355724033 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eacf11b5ea94c6386577eca24696b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cb3477628042869ffe08048f0a8ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:33.397252 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-b11150fc-de89-46d9-a99a-b39355724033 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] 10.222.0.113 "GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d" status: 200 len: 1557 microversion: 2.1 time: 0.178818 Jan 24 09:18:33.397847 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 115/250] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:33 2022] GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d => generated 1557 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:18:33.526664 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-91c7cb85-2e47-43d8-986a-74a7f8077189 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:33.535153 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-91c7cb85-2e47-43d8-986a-74a7f8077189 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/6b0c5b63-d2d9-4dbd-b01d-845151d57d74" status: 200 len: 1321 microversion: 2.1 time: 0.183781 Jan 24 09:18:33.535732 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 136/251] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:33 2022] GET /compute/v2.1/servers/6b0c5b63-d2d9-4dbd-b01d-845151d57d74 => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:18:33.693979 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-eb083fc7-7504-466c-9d00-ddf632d2c51c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:33.694668 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-eb083fc7-7504-466c-9d00-ddf632d2c51c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:33.701123 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-eb083fc7-7504-466c-9d00-ddf632d2c51c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:33.701576 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-eb083fc7-7504-466c-9d00-ddf632d2c51c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:33.702405 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-eb083fc7-7504-466c-9d00-ddf632d2c51c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:33.702840 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-eb083fc7-7504-466c-9d00-ddf632d2c51c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:33.774649 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-aaf7d870-4016-47e6-a80c-352553dcd92e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:33.775793 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-aaf7d870-4016-47e6-a80c-352553dcd92e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:33.785390 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-aaf7d870-4016-47e6-a80c-352553dcd92e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:33.786075 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-aaf7d870-4016-47e6-a80c-352553dcd92e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:33.787341 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-aaf7d870-4016-47e6-a80c-352553dcd92e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:33.787885 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-aaf7d870-4016-47e6-a80c-352553dcd92e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:33.871295 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-eb083fc7-7504-466c-9d00-ddf632d2c51c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:33.878418 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-eb083fc7-7504-466c-9d00-ddf632d2c51c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1525 microversion: 2.1 time: 0.188033 Jan 24 09:18:33.887819 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 116/252] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:33 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1525 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:18:33.893471 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-c34b61de-5bea-4002-9673-f6640a3b393f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:33.894475 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-c34b61de-5bea-4002-9673-f6640a3b393f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:33.899929 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-aaf7d870-4016-47e6-a80c-352553dcd92e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 14 microversion: 2.1 time: 0.131877 Jan 24 09:18:33.900800 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 137/253] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:18:33 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 24 09:18:33.901577 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c34b61de-5bea-4002-9673-f6640a3b393f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:33.902031 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c34b61de-5bea-4002-9673-f6640a3b393f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:33.902860 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c34b61de-5bea-4002-9673-f6640a3b393f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:33.903300 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c34b61de-5bea-4002-9673-f6640a3b393f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:34.000126 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-c34b61de-5bea-4002-9673-f6640a3b393f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 14 microversion: 2.20 time: 0.110654 Jan 24 09:18:34.000906 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 117/254] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:18:33 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:34.417267 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-068b2b89-6a68-4016-9ff8-1c690f724d85 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:34.418173 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-068b2b89-6a68-4016-9ff8-1c690f724d85 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] [instance: 8f231864-55f5-469d-b015-721a0ddc5e3d] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:34.425434 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-068b2b89-6a68-4016-9ff8-1c690f724d85 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:34.425961 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-068b2b89-6a68-4016-9ff8-1c690f724d85 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:34.426780 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-068b2b89-6a68-4016-9ff8-1c690f724d85 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:34.427224 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-068b2b89-6a68-4016-9ff8-1c690f724d85 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:34.552786 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-a23c3d65-0fab-47a0-882c-7cfff204fd05 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:34.553162 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-a23c3d65-0fab-47a0-882c-7cfff204fd05 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 6b0c5b63-d2d9-4dbd-b01d-845151d57d74] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:34.561972 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a23c3d65-0fab-47a0-882c-7cfff204fd05 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:34.562700 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a23c3d65-0fab-47a0-882c-7cfff204fd05 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:34.565724 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a23c3d65-0fab-47a0-882c-7cfff204fd05 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:34.566368 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a23c3d65-0fab-47a0-882c-7cfff204fd05 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:34.596056 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-068b2b89-6a68-4016-9ff8-1c690f724d85 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eacf11b5ea94c6386577eca24696b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cb3477628042869ffe08048f0a8ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:34.604553 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-068b2b89-6a68-4016-9ff8-1c690f724d85 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] 10.222.0.113 "GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d" status: 200 len: 1557 microversion: 2.1 time: 0.193613 Jan 24 09:18:34.605631 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 138/255] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:34 2022] GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d => generated 1557 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:34.716006 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-a23c3d65-0fab-47a0-882c-7cfff204fd05 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:34.724932 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-a23c3d65-0fab-47a0-882c-7cfff204fd05 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/6b0c5b63-d2d9-4dbd-b01d-845151d57d74" status: 200 len: 1321 microversion: 2.1 time: 0.177070 Jan 24 09:18:34.730512 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 118/256] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:34 2022] GET /compute/v2.1/servers/6b0c5b63-d2d9-4dbd-b01d-845151d57d74 => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:18:34.894484 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-cd17c395-4b4e-4db9-895e-9ee79a52f40d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:34.895095 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-cd17c395-4b4e-4db9-895e-9ee79a52f40d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:34.902230 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-cd17c395-4b4e-4db9-895e-9ee79a52f40d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:34.902679 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-cd17c395-4b4e-4db9-895e-9ee79a52f40d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:34.903471 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-cd17c395-4b4e-4db9-895e-9ee79a52f40d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:34.903907 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-cd17c395-4b4e-4db9-895e-9ee79a52f40d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:34.910714 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-92c54fb0-d33e-46e2-8508-dd0545242c92 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:34.912043 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-92c54fb0-d33e-46e2-8508-dd0545242c92 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:34.918995 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-92c54fb0-d33e-46e2-8508-dd0545242c92 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:34.919690 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-92c54fb0-d33e-46e2-8508-dd0545242c92 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:34.920790 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-92c54fb0-d33e-46e2-8508-dd0545242c92 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:34.921141 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-92c54fb0-d33e-46e2-8508-dd0545242c92 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:35.009070 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-92c54fb0-d33e-46e2-8508-dd0545242c92 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 14 microversion: 2.1 time: 0.102062 Jan 24 09:18:35.009808 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 119/257] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:18:34 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 24 09:18:35.018330 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-0c32b99a-aa01-40b6-b258-fa42052c2868 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:35.021011 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-0c32b99a-aa01-40b6-b258-fa42052c2868 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:35.027386 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0c32b99a-aa01-40b6-b258-fa42052c2868 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:35.027839 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0c32b99a-aa01-40b6-b258-fa42052c2868 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:35.028626 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0c32b99a-aa01-40b6-b258-fa42052c2868 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:35.029074 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0c32b99a-aa01-40b6-b258-fa42052c2868 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:35.064968 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-cd17c395-4b4e-4db9-895e-9ee79a52f40d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:35.072381 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-cd17c395-4b4e-4db9-895e-9ee79a52f40d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1525 microversion: 2.1 time: 0.181696 Jan 24 09:18:35.072962 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 139/258] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:34 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1525 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:35.109750 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-0c32b99a-aa01-40b6-b258-fa42052c2868 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 14 microversion: 2.20 time: 0.095453 Jan 24 09:18:35.110434 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 120/259] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:18:35 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:18:35.622227 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-86e35e84-e289-4328-b2e5-ff22b01ecc7a tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:35.636574 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-86e35e84-e289-4328-b2e5-ff22b01ecc7a tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] [instance: 8f231864-55f5-469d-b015-721a0ddc5e3d] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:35.636574 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-86e35e84-e289-4328-b2e5-ff22b01ecc7a tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:35.636574 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-86e35e84-e289-4328-b2e5-ff22b01ecc7a tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:35.636574 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-86e35e84-e289-4328-b2e5-ff22b01ecc7a tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:35.637300 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-86e35e84-e289-4328-b2e5-ff22b01ecc7a tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:35.748645 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-b6c4746c-9484-4dc3-b87c-8c8a1cc31e47 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:35.750079 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-b6c4746c-9484-4dc3-b87c-8c8a1cc31e47 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 6b0c5b63-d2d9-4dbd-b01d-845151d57d74] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:35.766288 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b6c4746c-9484-4dc3-b87c-8c8a1cc31e47 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:35.767168 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b6c4746c-9484-4dc3-b87c-8c8a1cc31e47 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:35.768950 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b6c4746c-9484-4dc3-b87c-8c8a1cc31e47 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:35.769656 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b6c4746c-9484-4dc3-b87c-8c8a1cc31e47 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:35.807021 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-86e35e84-e289-4328-b2e5-ff22b01ecc7a tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eacf11b5ea94c6386577eca24696b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cb3477628042869ffe08048f0a8ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:35.815787 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-86e35e84-e289-4328-b2e5-ff22b01ecc7a tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] 10.222.0.113 "GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d" status: 200 len: 1557 microversion: 2.1 time: 0.197296 Jan 24 09:18:35.816514 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 140/260] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:35 2022] GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d => generated 1557 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:35.821087 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [req-1b6eb40e-4aa7-4c48-942d-2d0c63b3e908 req-9d0ff989-8bfc-4e67-aa93-1ba2a68699bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b0c5b63-d2d9-4dbd-b01d-845151d57d74", "name": "network-vif-plugged", "status": "completed", "tag": "37794bd0-f89a-4e6a-8e1c-c7c7ab98e3c5"}]} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:35.822872 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:18:35.822872 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: warnings.warn(msg) Jan 24 09:18:35.830848 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-1b6eb40e-4aa7-4c48-942d-2d0c63b3e908 req-9d0ff989-8bfc-4e67-aa93-1ba2a68699bd service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:35.840720 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-1b6eb40e-4aa7-4c48-942d-2d0c63b3e908 req-9d0ff989-8bfc-4e67-aa93-1ba2a68699bd service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:35.842651 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.compute.server_external_events [req-1b6eb40e-4aa7-4c48-942d-2d0c63b3e908 req-9d0ff989-8bfc-4e67-aa93-1ba2a68699bd service nova] Creating event network-vif-plugged:37794bd0-f89a-4e6a-8e1c-c7c7ab98e3c5 for instance 6b0c5b63-d2d9-4dbd-b01d-845151d57d74 on hv-cinder-80403 Jan 24 09:18:35.847512 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [req-1b6eb40e-4aa7-4c48-942d-2d0c63b3e908 req-9d0ff989-8bfc-4e67-aa93-1ba2a68699bd service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029667 Jan 24 09:18:35.848114 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 141/261] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:18:36.020923 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-147ab855-f2a9-4352-aedc-1dfb996acfc1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:36.022189 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-147ab855-f2a9-4352-aedc-1dfb996acfc1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:36.029130 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-147ab855-f2a9-4352-aedc-1dfb996acfc1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:36.029578 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-147ab855-f2a9-4352-aedc-1dfb996acfc1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:36.030379 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-147ab855-f2a9-4352-aedc-1dfb996acfc1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:36.030964 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-147ab855-f2a9-4352-aedc-1dfb996acfc1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:36.086225 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-b6c4746c-9484-4dc3-b87c-8c8a1cc31e47 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:36.094117 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-b6c4746c-9484-4dc3-b87c-8c8a1cc31e47 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/6b0c5b63-d2d9-4dbd-b01d-845151d57d74" status: 200 len: 1321 microversion: 2.1 time: 0.350920 Jan 24 09:18:36.094706 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 121/262] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:35 2022] GET /compute/v2.1/servers/6b0c5b63-d2d9-4dbd-b01d-845151d57d74 => generated 1321 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:36.099379 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-b19e353a-1a16-430f-8503-cbbc00a43da4 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:36.100239 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-b19e353a-1a16-430f-8503-cbbc00a43da4 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:36.106448 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b19e353a-1a16-430f-8503-cbbc00a43da4 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:36.106903 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b19e353a-1a16-430f-8503-cbbc00a43da4 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:36.107724 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b19e353a-1a16-430f-8503-cbbc00a43da4 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:36.108164 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b19e353a-1a16-430f-8503-cbbc00a43da4 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:36.171621 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-147ab855-f2a9-4352-aedc-1dfb996acfc1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 14 microversion: 2.1 time: 0.155327 Jan 24 09:18:36.175635 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 142/263] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:18:36 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 14 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 24 09:18:36.180960 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-830f5781-72d6-4735-af46-91233734fad8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:36.182822 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-830f5781-72d6-4735-af46-91233734fad8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:36.191281 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-830f5781-72d6-4735-af46-91233734fad8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:36.191723 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-830f5781-72d6-4735-af46-91233734fad8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:36.192695 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-830f5781-72d6-4735-af46-91233734fad8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:36.193121 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-830f5781-72d6-4735-af46-91233734fad8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:36.271878 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-830f5781-72d6-4735-af46-91233734fad8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 14 microversion: 2.20 time: 0.097751 Jan 24 09:18:36.276698 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 143/264] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:18:36 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:36.336096 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [req-c4788bf4-b3aa-4094-b145-bd7f483c44d9 req-bf088429-b448-4f0f-a97b-303b14b349d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f231864-55f5-469d-b015-721a0ddc5e3d", "name": "network-vif-deleted", "tag": "af0ff79f-46d7-41b6-adb2-1f564fafaaba"}]} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:36.339534 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:18:36.339534 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: warnings.warn(msg) Jan 24 09:18:36.345749 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-c4788bf4-b3aa-4094-b145-bd7f483c44d9 req-bf088429-b448-4f0f-a97b-303b14b349d8 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:36.346368 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-c4788bf4-b3aa-4094-b145-bd7f483c44d9 req-bf088429-b448-4f0f-a97b-303b14b349d8 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:36.357946 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.compute.server_external_events [req-c4788bf4-b3aa-4094-b145-bd7f483c44d9 req-bf088429-b448-4f0f-a97b-303b14b349d8 service nova] Creating event network-vif-deleted:af0ff79f-46d7-41b6-adb2-1f564fafaaba for instance 8f231864-55f5-469d-b015-721a0ddc5e3d on hv-cinder-80403 Jan 24 09:18:36.363914 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [req-c4788bf4-b3aa-4094-b145-bd7f483c44d9 req-bf088429-b448-4f0f-a97b-303b14b349d8 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033243 Jan 24 09:18:36.364521 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 144/265] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 09:18:36.428848 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-b19e353a-1a16-430f-8503-cbbc00a43da4 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:36.444270 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-b19e353a-1a16-430f-8503-cbbc00a43da4 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1525 microversion: 2.1 time: 0.347663 Jan 24 09:18:36.445376 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 122/266] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:36 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1525 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:36.837722 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-020dde30-78dc-4a7c-9671-4a3057d00128 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:36.838450 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-020dde30-78dc-4a7c-9671-4a3057d00128 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] [instance: 8f231864-55f5-469d-b015-721a0ddc5e3d] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:36.844573 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-020dde30-78dc-4a7c-9671-4a3057d00128 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:36.845021 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-020dde30-78dc-4a7c-9671-4a3057d00128 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:36.845817 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-020dde30-78dc-4a7c-9671-4a3057d00128 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:36.846518 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-020dde30-78dc-4a7c-9671-4a3057d00128 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:36.906762 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-020dde30-78dc-4a7c-9671-4a3057d00128 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eacf11b5ea94c6386577eca24696b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cb3477628042869ffe08048f0a8ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:36.915011 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-020dde30-78dc-4a7c-9671-4a3057d00128 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] 10.222.0.113 "GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d" status: 200 len: 1350 microversion: 2.1 time: 0.081461 Jan 24 09:18:36.915682 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 145/267] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:36 2022] GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:37.110862 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-927e31dc-bc3b-47be-b50c-b1f02c07432d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:37.111781 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-927e31dc-bc3b-47be-b50c-b1f02c07432d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 6b0c5b63-d2d9-4dbd-b01d-845151d57d74] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:37.118236 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-927e31dc-bc3b-47be-b50c-b1f02c07432d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:37.118705 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-927e31dc-bc3b-47be-b50c-b1f02c07432d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:37.119511 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-927e31dc-bc3b-47be-b50c-b1f02c07432d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:37.119947 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-927e31dc-bc3b-47be-b50c-b1f02c07432d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:37.184333 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-100cc446-26d9-408e-b4e9-b511fae8f4b9 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:37.185403 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-100cc446-26d9-408e-b4e9-b511fae8f4b9 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:37.193844 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-100cc446-26d9-408e-b4e9-b511fae8f4b9 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:37.195839 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-100cc446-26d9-408e-b4e9-b511fae8f4b9 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:37.195839 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-100cc446-26d9-408e-b4e9-b511fae8f4b9 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:37.196030 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-100cc446-26d9-408e-b4e9-b511fae8f4b9 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:37.280013 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-100cc446-26d9-408e-b4e9-b511fae8f4b9 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 14 microversion: 2.1 time: 0.100678 Jan 24 09:18:37.280643 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 146/268] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:18:37 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 24 09:18:37.287435 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-122a9fbd-df8f-44e2-a06f-7bffab1f97ed tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:37.287648 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-927e31dc-bc3b-47be-b50c-b1f02c07432d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:37.288821 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-122a9fbd-df8f-44e2-a06f-7bffab1f97ed tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:37.295634 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-122a9fbd-df8f-44e2-a06f-7bffab1f97ed tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:37.296082 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-122a9fbd-df8f-44e2-a06f-7bffab1f97ed tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:37.296998 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-122a9fbd-df8f-44e2-a06f-7bffab1f97ed tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:37.297166 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-927e31dc-bc3b-47be-b50c-b1f02c07432d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/6b0c5b63-d2d9-4dbd-b01d-845151d57d74" status: 200 len: 1321 microversion: 2.1 time: 0.190121 Jan 24 09:18:37.297610 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-122a9fbd-df8f-44e2-a06f-7bffab1f97ed tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:37.298061 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 123/269] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:37 2022] GET /compute/v2.1/servers/6b0c5b63-d2d9-4dbd-b01d-845151d57d74 => generated 1321 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:37.428625 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-122a9fbd-df8f-44e2-a06f-7bffab1f97ed tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 4926 microversion: 2.20 time: 0.146420 Jan 24 09:18:37.429609 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 147/270] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:18:37 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 4926 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:18:37.460655 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-c8697679-86a0-4a80-bf8e-628ed615bb05 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:37.461268 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-c8697679-86a0-4a80-bf8e-628ed615bb05 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:37.467157 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c8697679-86a0-4a80-bf8e-628ed615bb05 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:37.467608 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c8697679-86a0-4a80-bf8e-628ed615bb05 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:37.468390 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c8697679-86a0-4a80-bf8e-628ed615bb05 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:37.468838 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c8697679-86a0-4a80-bf8e-628ed615bb05 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:37.609073 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-c8697679-86a0-4a80-bf8e-628ed615bb05 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:37.617687 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-c8697679-86a0-4a80-bf8e-628ed615bb05 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1525 microversion: 2.1 time: 0.160803 Jan 24 09:18:37.618279 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 124/271] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:37 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1525 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:18:37.933541 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-4d35f2b0-909c-4234-9f54-fbd820714299 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:37.934434 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-4d35f2b0-909c-4234-9f54-fbd820714299 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] [instance: 8f231864-55f5-469d-b015-721a0ddc5e3d] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:37.941995 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4d35f2b0-909c-4234-9f54-fbd820714299 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:37.942691 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4d35f2b0-909c-4234-9f54-fbd820714299 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:37.943284 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4d35f2b0-909c-4234-9f54-fbd820714299 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:37.943725 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4d35f2b0-909c-4234-9f54-fbd820714299 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:37.977709 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4d35f2b0-909c-4234-9f54-fbd820714299 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:37.978205 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4d35f2b0-909c-4234-9f54-fbd820714299 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:37.978756 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.objects.instance [None req-4d35f2b0-909c-4234-9f54-fbd820714299 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lazy-loading 'fault' on Instance uuid 8f231864-55f5-469d-b015-721a0ddc5e3d {{(pid=116864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 09:18:38.023046 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-4d35f2b0-909c-4234-9f54-fbd820714299 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eacf11b5ea94c6386577eca24696b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31cb3477628042869ffe08048f0a8ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:38.031211 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-4d35f2b0-909c-4234-9f54-fbd820714299 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] 10.222.0.113 "GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d" status: 200 len: 1355 microversion: 2.1 time: 0.101942 Jan 24 09:18:38.031763 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 148/272] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:37 2022] GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d => generated 1355 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:38.290957 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-79e3fbdb-e320-4e89-b347-353d39514d07 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:38.292072 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-79e3fbdb-e320-4e89-b347-353d39514d07 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:38.300716 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-79e3fbdb-e320-4e89-b347-353d39514d07 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:38.301302 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-79e3fbdb-e320-4e89-b347-353d39514d07 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:38.302236 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-79e3fbdb-e320-4e89-b347-353d39514d07 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:38.302777 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-79e3fbdb-e320-4e89-b347-353d39514d07 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:38.319918 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-b3e29ed7-9b24-49a6-9484-8cea929be095 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:38.321230 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-b3e29ed7-9b24-49a6-9484-8cea929be095 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 6b0c5b63-d2d9-4dbd-b01d-845151d57d74] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:38.332929 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b3e29ed7-9b24-49a6-9484-8cea929be095 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:38.334173 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b3e29ed7-9b24-49a6-9484-8cea929be095 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:38.335256 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b3e29ed7-9b24-49a6-9484-8cea929be095 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:38.348186 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b3e29ed7-9b24-49a6-9484-8cea929be095 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:38.454997 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-79e3fbdb-e320-4e89-b347-353d39514d07 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 3437 microversion: 2.1 time: 0.167664 Jan 24 09:18:38.455785 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 125/273] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:18:38 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 3437 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:18:38.460869 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-8f2e6dc6-8694-4f56-960c-4f5cc1da8a93 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:38.462062 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-8f2e6dc6-8694-4f56-960c-4f5cc1da8a93 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:38.471406 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8f2e6dc6-8694-4f56-960c-4f5cc1da8a93 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:38.471855 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8f2e6dc6-8694-4f56-960c-4f5cc1da8a93 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:38.472839 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8f2e6dc6-8694-4f56-960c-4f5cc1da8a93 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:38.473429 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8f2e6dc6-8694-4f56-960c-4f5cc1da8a93 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:38.498725 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-b3e29ed7-9b24-49a6-9484-8cea929be095 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:38.512791 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-b3e29ed7-9b24-49a6-9484-8cea929be095 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/6b0c5b63-d2d9-4dbd-b01d-845151d57d74" status: 200 len: 1321 microversion: 2.1 time: 0.202408 Jan 24 09:18:38.513391 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 149/274] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:38 2022] GET /compute/v2.1/servers/6b0c5b63-d2d9-4dbd-b01d-845151d57d74 => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:38.634867 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-d3c4d5b6-2c70-4d58-8f1f-194964ac4a61 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:38.635468 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-d3c4d5b6-2c70-4d58-8f1f-194964ac4a61 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:38.641227 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d3c4d5b6-2c70-4d58-8f1f-194964ac4a61 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:38.641672 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d3c4d5b6-2c70-4d58-8f1f-194964ac4a61 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:38.642526 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d3c4d5b6-2c70-4d58-8f1f-194964ac4a61 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:38.643028 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d3c4d5b6-2c70-4d58-8f1f-194964ac4a61 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:38.667547 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-8f2e6dc6-8694-4f56-960c-4f5cc1da8a93 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 6451 microversion: 2.20 time: 0.210113 Jan 24 09:18:38.668602 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 126/275] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:18:38 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 6451 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:18:38.797960 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-d3c4d5b6-2c70-4d58-8f1f-194964ac4a61 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:38.806280 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-d3c4d5b6-2c70-4d58-8f1f-194964ac4a61 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1525 microversion: 2.1 time: 0.175112 Jan 24 09:18:38.806860 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 150/276] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:38 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1525 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:18:39.048725 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-5447941f-f5a6-47a1-b1fd-ce6a9bdca455 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:39.054934 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-5447941f-f5a6-47a1-b1fd-ce6a9bdca455 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] [instance: 8f231864-55f5-469d-b015-721a0ddc5e3d] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:39.057931 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5447941f-f5a6-47a1-b1fd-ce6a9bdca455 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:39.058431 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5447941f-f5a6-47a1-b1fd-ce6a9bdca455 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:39.059243 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5447941f-f5a6-47a1-b1fd-ce6a9bdca455 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:39.059673 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5447941f-f5a6-47a1-b1fd-ce6a9bdca455 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:39.076667 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.wsgi [None req-5447941f-f5a6-47a1-b1fd-ce6a9bdca455 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] HTTP exception thrown: Instance 8f231864-55f5-469d-b015-721a0ddc5e3d could not be found. Jan 24 09:18:39.077254 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-5447941f-f5a6-47a1-b1fd-ce6a9bdca455 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Returning 404 to user: Instance 8f231864-55f5-469d-b015-721a0ddc5e3d could not be found. {{(pid=116863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:18:39.078089 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-5447941f-f5a6-47a1-b1fd-ce6a9bdca455 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] 10.222.0.113 "GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d" status: 404 len: 111 microversion: 2.1 time: 0.033509 Jan 24 09:18:39.078672 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 127/277] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:39 2022] GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 09:18:39.185857 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-5b652a82-61b4-448b-b6ef-f2d02491a825 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:39.186887 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-5b652a82-61b4-448b-b6ef-f2d02491a825 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] [instance: 8f231864-55f5-469d-b015-721a0ddc5e3d] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:39.198782 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5b652a82-61b4-448b-b6ef-f2d02491a825 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:39.204122 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5b652a82-61b4-448b-b6ef-f2d02491a825 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:39.204122 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5b652a82-61b4-448b-b6ef-f2d02491a825 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:39.204122 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5b652a82-61b4-448b-b6ef-f2d02491a825 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:39.214250 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.wsgi [None req-5b652a82-61b4-448b-b6ef-f2d02491a825 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] HTTP exception thrown: Instance 8f231864-55f5-469d-b015-721a0ddc5e3d could not be found. Jan 24 09:18:39.214876 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-5b652a82-61b4-448b-b6ef-f2d02491a825 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Returning 404 to user: Instance 8f231864-55f5-469d-b015-721a0ddc5e3d could not be found. {{(pid=116864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:18:39.215693 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-5b652a82-61b4-448b-b6ef-f2d02491a825 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] 10.222.0.113 "GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033575 Jan 24 09:18:39.216240 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 151/278] 10.222.0.113 () {58 vars in 1306 bytes} [Mon Jan 24 09:18:39 2022] GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 09:18:39.465997 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-04407ad1-d19b-422f-bb93-1c99631bdd44 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:39.466994 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-04407ad1-d19b-422f-bb93-1c99631bdd44 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:39.473339 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-04407ad1-d19b-422f-bb93-1c99631bdd44 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:39.473790 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-04407ad1-d19b-422f-bb93-1c99631bdd44 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:39.474581 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-04407ad1-d19b-422f-bb93-1c99631bdd44 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:39.475063 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-04407ad1-d19b-422f-bb93-1c99631bdd44 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:39.529676 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-f8e1b6d7-5f1d-4178-9ffa-2e74ca0ff139 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:39.530319 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-f8e1b6d7-5f1d-4178-9ffa-2e74ca0ff139 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 6b0c5b63-d2d9-4dbd-b01d-845151d57d74] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:39.536766 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f8e1b6d7-5f1d-4178-9ffa-2e74ca0ff139 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:39.537215 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f8e1b6d7-5f1d-4178-9ffa-2e74ca0ff139 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:39.537996 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f8e1b6d7-5f1d-4178-9ffa-2e74ca0ff139 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:39.538504 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f8e1b6d7-5f1d-4178-9ffa-2e74ca0ff139 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:39.595795 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-04407ad1-d19b-422f-bb93-1c99631bdd44 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 6451 microversion: 2.1 time: 0.133298 Jan 24 09:18:39.599977 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 128/279] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:18:39 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 6451 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:39.668498 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-f8e1b6d7-5f1d-4178-9ffa-2e74ca0ff139 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:39.676674 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-f8e1b6d7-5f1d-4178-9ffa-2e74ca0ff139 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/6b0c5b63-d2d9-4dbd-b01d-845151d57d74" status: 200 len: 1512 microversion: 2.1 time: 0.150574 Jan 24 09:18:39.677251 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 152/280] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:39 2022] GET /compute/v2.1/servers/6b0c5b63-d2d9-4dbd-b01d-845151d57d74 => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:18:39.679656 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-1b38b01b-6408-4afd-9dfb-eaab93caf522 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:39.681020 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-1b38b01b-6408-4afd-9dfb-eaab93caf522 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:39.687270 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1b38b01b-6408-4afd-9dfb-eaab93caf522 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:39.687881 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1b38b01b-6408-4afd-9dfb-eaab93caf522 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:39.688838 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1b38b01b-6408-4afd-9dfb-eaab93caf522 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:39.689402 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1b38b01b-6408-4afd-9dfb-eaab93caf522 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:39.695087 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-914b46bc-ab28-4132-9ab4-2b751a689754 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "263ee709-32cb-4613-9bcd-15fee6bb01ff"}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:39.696606 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-914b46bc-ab28-4132-9ab4-2b751a689754 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 6b0c5b63-d2d9-4dbd-b01d-845151d57d74] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:39.703012 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-914b46bc-ab28-4132-9ab4-2b751a689754 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:39.703469 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-914b46bc-ab28-4132-9ab4-2b751a689754 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:39.704320 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-914b46bc-ab28-4132-9ab4-2b751a689754 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:39.705389 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-914b46bc-ab28-4132-9ab4-2b751a689754 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:39.783760 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.wsgi [None req-914b46bc-ab28-4132-9ab4-2b751a689754 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] HTTP exception thrown: Invalid volume: volume 263ee709-32cb-4613-9bcd-15fee6bb01ff is already attached to instances: 334e86b7-8556-46c7-aad6-e5b2af845691 Jan 24 09:18:39.786124 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-914b46bc-ab28-4132-9ab4-2b751a689754 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Returning 400 to user: Invalid volume: volume 263ee709-32cb-4613-9bcd-15fee6bb01ff is already attached to instances: 334e86b7-8556-46c7-aad6-e5b2af845691 {{(pid=116864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:18:39.786124 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-914b46bc-ab28-4132-9ab4-2b751a689754 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "POST /compute/v2.1/servers/6b0c5b63-d2d9-4dbd-b01d-845151d57d74/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094876 Jan 24 09:18:39.786124 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 153/281] 10.222.0.113 () {60 vars in 1327 bytes} [Mon Jan 24 09:18:39 2022] POST /compute/v2.1/servers/6b0c5b63-d2d9-4dbd-b01d-845151d57d74/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 24 09:18:39.822468 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-5771684c-dbda-40fb-839c-fee1a6edc256 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:39.823091 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-5771684c-dbda-40fb-839c-fee1a6edc256 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:39.828911 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5771684c-dbda-40fb-839c-fee1a6edc256 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:39.829371 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5771684c-dbda-40fb-839c-fee1a6edc256 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:39.830225 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5771684c-dbda-40fb-839c-fee1a6edc256 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:39.832220 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5771684c-dbda-40fb-839c-fee1a6edc256 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:39.869262 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-1b38b01b-6408-4afd-9dfb-eaab93caf522 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 8423 microversion: 2.20 time: 0.194186 Jan 24 09:18:39.870324 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 129/282] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:18:39 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 8423 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 09:18:39.875212 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-e6af135a-f407-413e-bf35-270024440f8a tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:39.875790 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-e6af135a-f407-413e-bf35-270024440f8a tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 334e86b7-8556-46c7-aad6-e5b2af845691] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:39.883230 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e6af135a-f407-413e-bf35-270024440f8a tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:39.883663 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e6af135a-f407-413e-bf35-270024440f8a tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:39.884463 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e6af135a-f407-413e-bf35-270024440f8a tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:39.884903 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e6af135a-f407-413e-bf35-270024440f8a tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:39.965004 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-5771684c-dbda-40fb-839c-fee1a6edc256 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:39.973384 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-5771684c-dbda-40fb-839c-fee1a6edc256 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1525 microversion: 2.1 time: 0.154457 Jan 24 09:18:39.973956 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 154/283] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:39 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1525 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:18:40.013824 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.objects.instance [None req-e6af135a-f407-413e-bf35-270024440f8a tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lazy-loading 'services' on Instance uuid 334e86b7-8556-46c7-aad6-e5b2af845691 {{(pid=116863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 09:18:40.262132 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-e6af135a-f407-413e-bf35-270024440f8a tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "DELETE /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691/os-volume_attachments/263ee709-32cb-4613-9bcd-15fee6bb01ff" status: 202 len: 0 microversion: 2.1 time: 0.390597 Jan 24 09:18:40.262660 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 130/284] 10.222.0.113 () {58 vars in 1420 bytes} [Mon Jan 24 09:18:39 2022] DELETE /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691/os-volume_attachments/263ee709-32cb-4613-9bcd-15fee6bb01ff => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:18:40.271897 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-c3dd45be-1281-4d56-8649-bca7b178848d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:40.272986 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-c3dd45be-1281-4d56-8649-bca7b178848d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 334e86b7-8556-46c7-aad6-e5b2af845691] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:40.278816 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c3dd45be-1281-4d56-8649-bca7b178848d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:40.279257 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c3dd45be-1281-4d56-8649-bca7b178848d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:40.280053 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c3dd45be-1281-4d56-8649-bca7b178848d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:40.280482 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c3dd45be-1281-4d56-8649-bca7b178848d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:40.313368 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-c3dd45be-1281-4d56-8649-bca7b178848d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046030 Jan 24 09:18:40.313903 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 155/285] 10.222.0.113 () {58 vars in 1306 bytes} [Mon Jan 24 09:18:40 2022] GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:18:40.572189 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-b5f1a16a-6675-4bf6-9228-afc60924b678 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:40.572807 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-b5f1a16a-6675-4bf6-9228-afc60924b678 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] [instance: 8f231864-55f5-469d-b015-721a0ddc5e3d] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:40.579036 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b5f1a16a-6675-4bf6-9228-afc60924b678 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:40.579491 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b5f1a16a-6675-4bf6-9228-afc60924b678 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:40.583710 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b5f1a16a-6675-4bf6-9228-afc60924b678 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:40.583710 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b5f1a16a-6675-4bf6-9228-afc60924b678 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:40.597626 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.wsgi [None req-b5f1a16a-6675-4bf6-9228-afc60924b678 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] HTTP exception thrown: Instance 8f231864-55f5-469d-b015-721a0ddc5e3d could not be found. Jan 24 09:18:40.598247 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-b5f1a16a-6675-4bf6-9228-afc60924b678 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Returning 404 to user: Instance 8f231864-55f5-469d-b015-721a0ddc5e3d could not be found. {{(pid=116863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:18:40.599083 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-b5f1a16a-6675-4bf6-9228-afc60924b678 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] 10.222.0.113 "DELETE /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d" status: 404 len: 111 microversion: 2.1 time: 0.031424 Jan 24 09:18:40.599637 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 131/286] 10.222.0.113 () {58 vars in 1243 bytes} [Mon Jan 24 09:18:40 2022] DELETE /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 09:18:40.607164 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-02759524-adbb-4c31-8a5c-94f5a39f86f7 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:40.607686 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-c7a4ab6d-105d-4c09-b5f9-f3c15a3bed41 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:40.608246 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-02759524-adbb-4c31-8a5c-94f5a39f86f7 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] [instance: 8f231864-55f5-469d-b015-721a0ddc5e3d] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:40.608661 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-c7a4ab6d-105d-4c09-b5f9-f3c15a3bed41 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:40.614615 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-02759524-adbb-4c31-8a5c-94f5a39f86f7 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:40.615071 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-02759524-adbb-4c31-8a5c-94f5a39f86f7 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:40.615726 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c7a4ab6d-105d-4c09-b5f9-f3c15a3bed41 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:40.615879 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-02759524-adbb-4c31-8a5c-94f5a39f86f7 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:40.616288 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-02759524-adbb-4c31-8a5c-94f5a39f86f7 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:40.616478 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c7a4ab6d-105d-4c09-b5f9-f3c15a3bed41 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:40.617246 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c7a4ab6d-105d-4c09-b5f9-f3c15a3bed41 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:40.617744 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c7a4ab6d-105d-4c09-b5f9-f3c15a3bed41 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:40.630263 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.wsgi [None req-02759524-adbb-4c31-8a5c-94f5a39f86f7 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] HTTP exception thrown: Instance 8f231864-55f5-469d-b015-721a0ddc5e3d could not be found. Jan 24 09:18:40.630856 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-02759524-adbb-4c31-8a5c-94f5a39f86f7 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] Returning 404 to user: Instance 8f231864-55f5-469d-b015-721a0ddc5e3d could not be found. {{(pid=116863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:18:40.631685 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-02759524-adbb-4c31-8a5c-94f5a39f86f7 tempest-DeleteServersTestJSON-610017206 tempest-DeleteServersTestJSON-610017206-project] 10.222.0.113 "GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d" status: 404 len: 111 microversion: 2.1 time: 0.028046 Jan 24 09:18:40.632276 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 132/287] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:40 2022] GET /compute/v2.1/servers/8f231864-55f5-469d-b015-721a0ddc5e3d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 09:18:40.767948 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-c7a4ab6d-105d-4c09-b5f9-f3c15a3bed41 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 9302 microversion: 2.1 time: 0.163872 Jan 24 09:18:40.771863 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 156/288] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:18:40 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 9302 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:40.881420 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-5834c7be-5100-4ec5-ba16-af35bd2a6d6b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:40.882442 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-5834c7be-5100-4ec5-ba16-af35bd2a6d6b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:40.888414 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5834c7be-5100-4ec5-ba16-af35bd2a6d6b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:40.888902 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5834c7be-5100-4ec5-ba16-af35bd2a6d6b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:40.889684 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5834c7be-5100-4ec5-ba16-af35bd2a6d6b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:40.890136 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5834c7be-5100-4ec5-ba16-af35bd2a6d6b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:40.992699 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-d7722edd-59f1-4332-9c2f-938d7c5e87c9 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:40.992699 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-d7722edd-59f1-4332-9c2f-938d7c5e87c9 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:41.000654 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d7722edd-59f1-4332-9c2f-938d7c5e87c9 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:41.001128 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d7722edd-59f1-4332-9c2f-938d7c5e87c9 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:41.001920 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d7722edd-59f1-4332-9c2f-938d7c5e87c9 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:41.002403 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d7722edd-59f1-4332-9c2f-938d7c5e87c9 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:41.063501 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-5834c7be-5100-4ec5-ba16-af35bd2a6d6b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 10893 microversion: 2.20 time: 0.186514 Jan 24 09:18:41.064156 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 133/289] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:18:40 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 10893 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:18:41.156989 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-d7722edd-59f1-4332-9c2f-938d7c5e87c9 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:41.165002 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-d7722edd-59f1-4332-9c2f-938d7c5e87c9 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1525 microversion: 2.1 time: 0.179056 Jan 24 09:18:41.165805 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 157/290] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:40 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1525 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:41.330864 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-e4bcf50b-6ec3-40f0-8b0d-738d24e16105 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:41.332286 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-e4bcf50b-6ec3-40f0-8b0d-738d24e16105 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 334e86b7-8556-46c7-aad6-e5b2af845691] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:41.339598 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e4bcf50b-6ec3-40f0-8b0d-738d24e16105 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:41.340166 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e4bcf50b-6ec3-40f0-8b0d-738d24e16105 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:41.345645 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e4bcf50b-6ec3-40f0-8b0d-738d24e16105 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:41.345645 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e4bcf50b-6ec3-40f0-8b0d-738d24e16105 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:41.376353 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-e4bcf50b-6ec3-40f0-8b0d-738d24e16105 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049832 Jan 24 09:18:41.376931 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 134/291] 10.222.0.113 () {58 vars in 1306 bytes} [Mon Jan 24 09:18:41 2022] GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:18:41.779994 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-d0b5c53f-b6da-47cb-b080-526a4521b5f2 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:41.780939 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-d0b5c53f-b6da-47cb-b080-526a4521b5f2 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:41.789254 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d0b5c53f-b6da-47cb-b080-526a4521b5f2 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:41.789676 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d0b5c53f-b6da-47cb-b080-526a4521b5f2 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:41.790494 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d0b5c53f-b6da-47cb-b080-526a4521b5f2 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:41.790932 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d0b5c53f-b6da-47cb-b080-526a4521b5f2 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:41.954601 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-d0b5c53f-b6da-47cb-b080-526a4521b5f2 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 11351 microversion: 2.1 time: 0.178478 Jan 24 09:18:41.955881 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 158/292] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:18:41 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 11351 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 09:18:42.075172 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-853ddd5d-002e-49eb-b4dd-1a3e911da7db tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:42.076018 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-853ddd5d-002e-49eb-b4dd-1a3e911da7db tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:42.082757 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-853ddd5d-002e-49eb-b4dd-1a3e911da7db tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:42.083213 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-853ddd5d-002e-49eb-b4dd-1a3e911da7db tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:42.084016 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-853ddd5d-002e-49eb-b4dd-1a3e911da7db tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:42.084461 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-853ddd5d-002e-49eb-b4dd-1a3e911da7db tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:42.184775 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-ceb8bf30-9fd1-4149-96ee-77a3f9a3bf76 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:42.186907 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-ceb8bf30-9fd1-4149-96ee-77a3f9a3bf76 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:42.212320 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ceb8bf30-9fd1-4149-96ee-77a3f9a3bf76 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:42.212938 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ceb8bf30-9fd1-4149-96ee-77a3f9a3bf76 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:42.213784 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ceb8bf30-9fd1-4149-96ee-77a3f9a3bf76 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:42.214324 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ceb8bf30-9fd1-4149-96ee-77a3f9a3bf76 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:42.227792 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-853ddd5d-002e-49eb-b4dd-1a3e911da7db tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 13039 microversion: 2.20 time: 0.156243 Jan 24 09:18:42.228455 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 135/293] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:18:42 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 13039 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:18:42.368453 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-ceb8bf30-9fd1-4149-96ee-77a3f9a3bf76 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:42.375940 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-ceb8bf30-9fd1-4149-96ee-77a3f9a3bf76 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1525 microversion: 2.1 time: 0.197637 Jan 24 09:18:42.376505 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 159/294] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:42 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1525 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:42.389464 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-dddbb872-ec3b-40b3-a950-00940c90e712 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:42.390479 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-dddbb872-ec3b-40b3-a950-00940c90e712 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 334e86b7-8556-46c7-aad6-e5b2af845691] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:42.397386 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-dddbb872-ec3b-40b3-a950-00940c90e712 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:42.397830 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-dddbb872-ec3b-40b3-a950-00940c90e712 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:42.398627 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-dddbb872-ec3b-40b3-a950-00940c90e712 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:42.399053 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-dddbb872-ec3b-40b3-a950-00940c90e712 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:42.448443 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-dddbb872-ec3b-40b3-a950-00940c90e712 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062712 Jan 24 09:18:42.449195 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 136/295] 10.222.0.113 () {58 vars in 1306 bytes} [Mon Jan 24 09:18:42 2022] GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 09:18:42.622743 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-fd835113-f8f1-4a3c-acf9-fa1c0e449801 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1495263228", "imageRef": "c527e37f-a381-465e-babe-11528029ed9b", "flavorRef": "452", "networks": [{"uuid": "595abfef-3114-4487-9adf-a62cd7425c5d"}]}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:42.966344 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-9dd477ec-b4ee-4f66-8a9c-754d80928c63 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:42.967315 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-9dd477ec-b4ee-4f66-8a9c-754d80928c63 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:42.973738 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9dd477ec-b4ee-4f66-8a9c-754d80928c63 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:42.974212 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9dd477ec-b4ee-4f66-8a9c-754d80928c63 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:42.975005 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9dd477ec-b4ee-4f66-8a9c-754d80928c63 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:42.975448 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9dd477ec-b4ee-4f66-8a9c-754d80928c63 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:43.113778 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-9dd477ec-b4ee-4f66-8a9c-754d80928c63 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 14047 microversion: 2.1 time: 0.150800 Jan 24 09:18:43.114441 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 137/296] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:18:42 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 14047 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:18:43.239771 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-7dc4512f-c80a-4dcd-b7df-244515c0b07e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:43.240777 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-7dc4512f-c80a-4dcd-b7df-244515c0b07e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:43.247745 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7dc4512f-c80a-4dcd-b7df-244515c0b07e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:43.248199 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7dc4512f-c80a-4dcd-b7df-244515c0b07e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:43.248982 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7dc4512f-c80a-4dcd-b7df-244515c0b07e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:43.249416 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7dc4512f-c80a-4dcd-b7df-244515c0b07e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:43.368702 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-7dc4512f-c80a-4dcd-b7df-244515c0b07e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 15064 microversion: 2.20 time: 0.132750 Jan 24 09:18:43.369433 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 138/297] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:18:43 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 15064 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 09:18:43.393057 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-32ee1901-053f-4b20-8959-61627663f5a1 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:43.393865 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-32ee1901-053f-4b20-8959-61627663f5a1 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:43.401150 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-32ee1901-053f-4b20-8959-61627663f5a1 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:43.401596 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-32ee1901-053f-4b20-8959-61627663f5a1 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:43.402448 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-32ee1901-053f-4b20-8959-61627663f5a1 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:43.402879 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-32ee1901-053f-4b20-8959-61627663f5a1 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:43.548908 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-32ee1901-053f-4b20-8959-61627663f5a1 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:43.557580 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-32ee1901-053f-4b20-8959-61627663f5a1 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1525 microversion: 2.1 time: 0.168451 Jan 24 09:18:43.558372 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 139/298] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:43 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1525 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:44.124653 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-bbf2c843-aab0-44fe-a95a-c9c3ebcb628d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:44.125574 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-bbf2c843-aab0-44fe-a95a-c9c3ebcb628d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:44.133439 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bbf2c843-aab0-44fe-a95a-c9c3ebcb628d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:44.133439 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bbf2c843-aab0-44fe-a95a-c9c3ebcb628d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:44.133439 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bbf2c843-aab0-44fe-a95a-c9c3ebcb628d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:44.133439 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bbf2c843-aab0-44fe-a95a-c9c3ebcb628d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:44.225130 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-bbf2c843-aab0-44fe-a95a-c9c3ebcb628d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 15651 microversion: 2.1 time: 0.103899 Jan 24 09:18:44.228638 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 140/299] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:18:44 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 15651 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 09:18:44.381025 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-341a82b5-9edf-4ca7-b966-dfddb157bf4c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:44.382258 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-341a82b5-9edf-4ca7-b966-dfddb157bf4c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:44.391285 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-341a82b5-9edf-4ca7-b966-dfddb157bf4c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:44.392327 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-341a82b5-9edf-4ca7-b966-dfddb157bf4c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:44.396822 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-341a82b5-9edf-4ca7-b966-dfddb157bf4c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:44.398207 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-341a82b5-9edf-4ca7-b966-dfddb157bf4c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:44.556706 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-341a82b5-9edf-4ca7-b966-dfddb157bf4c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 17242 microversion: 2.20 time: 0.179585 Jan 24 09:18:44.557365 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 141/300] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:18:44 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 17242 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 09:18:44.575355 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-f46fe0e3-4742-437a-81c4-075f3c4cafb4 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:44.576056 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-f46fe0e3-4742-437a-81c4-075f3c4cafb4 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:44.583249 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f46fe0e3-4742-437a-81c4-075f3c4cafb4 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:44.583710 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f46fe0e3-4742-437a-81c4-075f3c4cafb4 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:44.584496 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f46fe0e3-4742-437a-81c4-075f3c4cafb4 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:44.584935 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f46fe0e3-4742-437a-81c4-075f3c4cafb4 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:44.719551 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-f46fe0e3-4742-437a-81c4-075f3c4cafb4 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:44.728257 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-f46fe0e3-4742-437a-81c4-075f3c4cafb4 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1525 microversion: 2.1 time: 0.156953 Jan 24 09:18:44.728856 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 142/301] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:44 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1525 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:18:45.236453 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-354bd79e-a570-4db3-8db3-499667bac49b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:45.237409 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-354bd79e-a570-4db3-8db3-499667bac49b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:45.243911 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-354bd79e-a570-4db3-8db3-499667bac49b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:45.244366 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-354bd79e-a570-4db3-8db3-499667bac49b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:45.245143 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-354bd79e-a570-4db3-8db3-499667bac49b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:45.245579 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-354bd79e-a570-4db3-8db3-499667bac49b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:45.345074 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-354bd79e-a570-4db3-8db3-499667bac49b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 17602 microversion: 2.1 time: 0.112197 Jan 24 09:18:45.345724 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 143/302] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:18:45 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 17602 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 09:18:45.567784 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-7c9913a7-fbdd-4e83-9382-6dfa5d2946b2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:45.568924 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-7c9913a7-fbdd-4e83-9382-6dfa5d2946b2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:45.575723 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7c9913a7-fbdd-4e83-9382-6dfa5d2946b2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:45.576172 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7c9913a7-fbdd-4e83-9382-6dfa5d2946b2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:45.576958 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7c9913a7-fbdd-4e83-9382-6dfa5d2946b2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:45.577391 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7c9913a7-fbdd-4e83-9382-6dfa5d2946b2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:45.676026 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-7c9913a7-fbdd-4e83-9382-6dfa5d2946b2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 17498 microversion: 2.20 time: 0.112213 Jan 24 09:18:45.676892 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 144/303] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:18:45 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 17498 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 09:18:45.745239 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-880bdaf5-418d-4b6f-abd1-9ff3e6f7a5e0 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:45.745844 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-880bdaf5-418d-4b6f-abd1-9ff3e6f7a5e0 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:45.752772 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-880bdaf5-418d-4b6f-abd1-9ff3e6f7a5e0 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:45.753402 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-880bdaf5-418d-4b6f-abd1-9ff3e6f7a5e0 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:45.754417 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-880bdaf5-418d-4b6f-abd1-9ff3e6f7a5e0 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:45.754862 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-880bdaf5-418d-4b6f-abd1-9ff3e6f7a5e0 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:45.893248 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-880bdaf5-418d-4b6f-abd1-9ff3e6f7a5e0 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:45.902479 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-880bdaf5-418d-4b6f-abd1-9ff3e6f7a5e0 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1525 microversion: 2.1 time: 0.161179 Jan 24 09:18:45.903142 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 145/304] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:45 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1525 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:18:46.357104 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-d3818bfb-9407-4d0f-a087-e9d388889755 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:46.358083 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-d3818bfb-9407-4d0f-a087-e9d388889755 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:46.364476 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d3818bfb-9407-4d0f-a087-e9d388889755 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:46.364928 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d3818bfb-9407-4d0f-a087-e9d388889755 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:46.365739 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d3818bfb-9407-4d0f-a087-e9d388889755 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:46.366199 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d3818bfb-9407-4d0f-a087-e9d388889755 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:46.451429 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-d3818bfb-9407-4d0f-a087-e9d388889755 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 17602 microversion: 2.1 time: 0.097867 Jan 24 09:18:46.452087 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 146/305] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:18:46 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 17602 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 09:18:46.688502 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-21611e80-49a3-4e39-9ebd-1f615e87dfbc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:46.689564 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-21611e80-49a3-4e39-9ebd-1f615e87dfbc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:46.697760 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-21611e80-49a3-4e39-9ebd-1f615e87dfbc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:46.698244 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-21611e80-49a3-4e39-9ebd-1f615e87dfbc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:46.699099 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-21611e80-49a3-4e39-9ebd-1f615e87dfbc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:46.699537 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-21611e80-49a3-4e39-9ebd-1f615e87dfbc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:46.790770 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-21611e80-49a3-4e39-9ebd-1f615e87dfbc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 18126 microversion: 2.20 time: 0.106213 Jan 24 09:18:46.791417 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 147/306] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:18:46 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 18126 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:18:46.921099 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-ee0e5e2d-c033-4be0-a9c6-22150a248b57 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:46.921864 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-ee0e5e2d-c033-4be0-a9c6-22150a248b57 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:46.929533 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ee0e5e2d-c033-4be0-a9c6-22150a248b57 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:46.929980 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ee0e5e2d-c033-4be0-a9c6-22150a248b57 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:46.930788 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ee0e5e2d-c033-4be0-a9c6-22150a248b57 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:46.931322 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ee0e5e2d-c033-4be0-a9c6-22150a248b57 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:47.279118 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-ee0e5e2d-c033-4be0-a9c6-22150a248b57 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:47.290993 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-ee0e5e2d-c033-4be0-a9c6-22150a248b57 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1525 microversion: 2.1 time: 0.371952 Jan 24 09:18:47.290993 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 148/307] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:46 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1525 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:47.470229 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-f61efcc2-f6e5-4efc-be9a-e2504a89446e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:47.471145 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-f61efcc2-f6e5-4efc-be9a-e2504a89446e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:47.479289 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f61efcc2-f6e5-4efc-be9a-e2504a89446e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:47.479746 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f61efcc2-f6e5-4efc-be9a-e2504a89446e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:47.480534 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f61efcc2-f6e5-4efc-be9a-e2504a89446e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:47.480976 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f61efcc2-f6e5-4efc-be9a-e2504a89446e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:47.585849 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-f61efcc2-f6e5-4efc-be9a-e2504a89446e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 19342 microversion: 2.1 time: 0.119118 Jan 24 09:18:47.587620 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 149/308] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:18:47 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 19342 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 09:18:47.802729 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-5180bdc3-e6da-4e9e-89c2-fd5d344d29c0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:47.804036 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-5180bdc3-e6da-4e9e-89c2-fd5d344d29c0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:47.810936 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5180bdc3-e6da-4e9e-89c2-fd5d344d29c0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:47.811389 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5180bdc3-e6da-4e9e-89c2-fd5d344d29c0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:47.812174 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5180bdc3-e6da-4e9e-89c2-fd5d344d29c0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:47.812615 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5180bdc3-e6da-4e9e-89c2-fd5d344d29c0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:47.923795 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-5180bdc3-e6da-4e9e-89c2-fd5d344d29c0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 19342 microversion: 2.20 time: 0.125792 Jan 24 09:18:47.925167 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 150/309] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:18:47 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 19342 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 09:18:48.308358 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-761776b1-7cae-406d-b3ef-d22b8716f9f8 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:48.309065 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-761776b1-7cae-406d-b3ef-d22b8716f9f8 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:48.316194 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-761776b1-7cae-406d-b3ef-d22b8716f9f8 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:48.316680 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-761776b1-7cae-406d-b3ef-d22b8716f9f8 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:48.317485 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-761776b1-7cae-406d-b3ef-d22b8716f9f8 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:48.317870 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-761776b1-7cae-406d-b3ef-d22b8716f9f8 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:48.465632 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-761776b1-7cae-406d-b3ef-d22b8716f9f8 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:48.473492 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-761776b1-7cae-406d-b3ef-d22b8716f9f8 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1525 microversion: 2.1 time: 0.169909 Jan 24 09:18:48.474130 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 151/310] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:48 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1525 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:18:48.598358 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-dfd63d3e-1a0e-4478-a7b3-d7e843349bfc tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:48.599282 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-dfd63d3e-1a0e-4478-a7b3-d7e843349bfc tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:48.605551 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-dfd63d3e-1a0e-4478-a7b3-d7e843349bfc tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:48.605990 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-dfd63d3e-1a0e-4478-a7b3-d7e843349bfc tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:48.606872 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-dfd63d3e-1a0e-4478-a7b3-d7e843349bfc tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:48.607314 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-dfd63d3e-1a0e-4478-a7b3-d7e843349bfc tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:52.443834 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-dfd63d3e-1a0e-4478-a7b3-d7e843349bfc tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 23763 microversion: 2.1 time: 3.848528 Jan 24 09:18:52.445876 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 152/311] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:18:48 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 23763 bytes in 3851 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 09:18:52.450321 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-ce0a6aba-9875-401e-b6a7-b0f813fa6480 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:52.451330 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-ce0a6aba-9875-401e-b6a7-b0f813fa6480 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:52.458365 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ce0a6aba-9875-401e-b6a7-b0f813fa6480 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:52.458816 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ce0a6aba-9875-401e-b6a7-b0f813fa6480 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:52.459600 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ce0a6aba-9875-401e-b6a7-b0f813fa6480 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:52.460709 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ce0a6aba-9875-401e-b6a7-b0f813fa6480 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:52.582746 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-ce0a6aba-9875-401e-b6a7-b0f813fa6480 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 23792 microversion: 2.20 time: 0.136103 Jan 24 09:18:52.583335 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 153/312] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:18:52 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 23792 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:18:52.589853 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-19230bc0-c568-488e-a0b4-26f3a9b70ab0 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:52.590967 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-19230bc0-c568-488e-a0b4-26f3a9b70ab0 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:52.597740 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-19230bc0-c568-488e-a0b4-26f3a9b70ab0 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:52.599794 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-19230bc0-c568-488e-a0b4-26f3a9b70ab0 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:52.599794 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-19230bc0-c568-488e-a0b4-26f3a9b70ab0 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:52.599794 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-19230bc0-c568-488e-a0b4-26f3a9b70ab0 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:52.729898 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-19230bc0-c568-488e-a0b4-26f3a9b70ab0 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:52.737717 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-19230bc0-c568-488e-a0b4-26f3a9b70ab0 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1525 microversion: 2.1 time: 0.153079 Jan 24 09:18:52.738336 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 154/313] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:52 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1525 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:53.454727 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-00d2be00-7f4c-412c-9d63-77ceb1c21a4b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:53.455713 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-00d2be00-7f4c-412c-9d63-77ceb1c21a4b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:53.462618 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-00d2be00-7f4c-412c-9d63-77ceb1c21a4b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:53.463069 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-00d2be00-7f4c-412c-9d63-77ceb1c21a4b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:53.463855 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-00d2be00-7f4c-412c-9d63-77ceb1c21a4b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:53.464291 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-00d2be00-7f4c-412c-9d63-77ceb1c21a4b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:53.582397 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-00d2be00-7f4c-412c-9d63-77ceb1c21a4b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 24120 microversion: 2.1 time: 0.131300 Jan 24 09:18:53.583047 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 155/314] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:18:53 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 24120 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 09:18:53.595847 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-48326087-d207-4900-8f8b-cb284da80e48 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:53.596868 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-48326087-d207-4900-8f8b-cb284da80e48 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:53.603738 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-48326087-d207-4900-8f8b-cb284da80e48 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:53.604187 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-48326087-d207-4900-8f8b-cb284da80e48 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:53.604959 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-48326087-d207-4900-8f8b-cb284da80e48 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:53.605388 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-48326087-d207-4900-8f8b-cb284da80e48 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:53.726796 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-48326087-d207-4900-8f8b-cb284da80e48 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 24320 microversion: 2.20 time: 0.134656 Jan 24 09:18:53.727789 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 156/315] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:18:53 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 24320 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 09:18:53.758441 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-777f3613-3e4f-4dc0-b2d6-72c7c7525916 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:53.759082 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-777f3613-3e4f-4dc0-b2d6-72c7c7525916 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:53.766296 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-777f3613-3e4f-4dc0-b2d6-72c7c7525916 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:53.766747 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-777f3613-3e4f-4dc0-b2d6-72c7c7525916 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:53.767579 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-777f3613-3e4f-4dc0-b2d6-72c7c7525916 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:53.768028 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-777f3613-3e4f-4dc0-b2d6-72c7c7525916 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:53.921594 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-777f3613-3e4f-4dc0-b2d6-72c7c7525916 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:53.930799 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-777f3613-3e4f-4dc0-b2d6-72c7c7525916 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1525 microversion: 2.1 time: 0.176856 Jan 24 09:18:53.934902 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 157/316] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:53 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1525 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:18:54.600189 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-bbfcb5a6-57f6-4d5b-b0ff-89d25d602316 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:54.601122 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-bbfcb5a6-57f6-4d5b-b0ff-89d25d602316 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:54.612462 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bbfcb5a6-57f6-4d5b-b0ff-89d25d602316 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:54.612891 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bbfcb5a6-57f6-4d5b-b0ff-89d25d602316 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:54.613669 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bbfcb5a6-57f6-4d5b-b0ff-89d25d602316 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:54.614400 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bbfcb5a6-57f6-4d5b-b0ff-89d25d602316 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:54.736049 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-bbfcb5a6-57f6-4d5b-b0ff-89d25d602316 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 24625 microversion: 2.1 time: 0.144191 Jan 24 09:18:54.737306 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 158/317] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:18:54 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 24625 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:18:54.747489 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-2cc83ede-5612-432b-9533-42772bac4acb tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:54.749300 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-2cc83ede-5612-432b-9533-42772bac4acb tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:54.762703 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-2cc83ede-5612-432b-9533-42772bac4acb tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:54.763174 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-2cc83ede-5612-432b-9533-42772bac4acb tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:54.764067 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-2cc83ede-5612-432b-9533-42772bac4acb tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:54.764515 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-2cc83ede-5612-432b-9533-42772bac4acb tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:54.886031 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-2cc83ede-5612-432b-9533-42772bac4acb tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 24978 microversion: 2.20 time: 0.146744 Jan 24 09:18:54.886869 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 159/318] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:18:54 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 24978 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:18:54.895288 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.network.neutron [None req-fd835113-f8f1-4a3c-acf9-fa1c0e449801 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] validate_networks() for [('595abfef-3114-4487-9adf-a62cd7425c5d', None, None, None, None, None)] {{(pid=116864) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 09:18:54.956086 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-527541fc-a72f-4286-b9da-bb12a483edfb tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:54.956792 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-527541fc-a72f-4286-b9da-bb12a483edfb tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:54.964635 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-527541fc-a72f-4286-b9da-bb12a483edfb tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:54.965088 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-527541fc-a72f-4286-b9da-bb12a483edfb tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:54.965885 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-527541fc-a72f-4286-b9da-bb12a483edfb tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:54.966348 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-527541fc-a72f-4286-b9da-bb12a483edfb tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:55.112421 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-527541fc-a72f-4286-b9da-bb12a483edfb tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:55.120347 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-527541fc-a72f-4286-b9da-bb12a483edfb tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1525 microversion: 2.1 time: 0.169168 Jan 24 09:18:55.121179 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 160/319] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:54 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1525 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:18:55.282744 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-fd835113-f8f1-4a3c-acf9-fa1c0e449801 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Flavor limits 0:0:0 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 09:18:55.283202 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-fd835113-f8f1-4a3c-acf9-fa1c0e449801 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Image limits 0:0:0 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 09:18:55.283702 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-fd835113-f8f1-4a3c-acf9-fa1c0e449801 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Flavor pref 0:0:0 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 09:18:55.284116 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-fd835113-f8f1-4a3c-acf9-fa1c0e449801 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Image pref 0:0:0 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 09:18:55.284588 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-fd835113-f8f1-4a3c-acf9-fa1c0e449801 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 09:18:55.294211 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fd835113-f8f1-4a3c-acf9-fa1c0e449801 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:55.294685 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fd835113-f8f1-4a3c-acf9-fa1c0e449801 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:55.295539 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fd835113-f8f1-4a3c-acf9-fa1c0e449801 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:55.295973 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fd835113-f8f1-4a3c-acf9-fa1c0e449801 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:55.313659 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.quota [None req-fd835113-f8f1-4a3c-acf9-fa1c0e449801 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Getting quotas for project 9effc220352541ecba9f319db87235de. Resources: {'ram', 'cores', 'instances'} {{(pid=116864) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 09:18:55.317596 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.quota [None req-fd835113-f8f1-4a3c-acf9-fa1c0e449801 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Getting quotas for user 49d33f34357f4132b712dff54a6446f3 and project 9effc220352541ecba9f319db87235de. Resources: {'ram', 'cores', 'instances'} {{(pid=116864) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 09:18:55.328872 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-fd835113-f8f1-4a3c-acf9-fa1c0e449801 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Going to run 1 instances... {{(pid=116864) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 09:18:55.331215 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-fd835113-f8f1-4a3c-acf9-fa1c0e449801 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: f73fa07f-65bf-45c0-afb7-c5bfb0356243] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c527e37f-a381-465e-babe-11528029ed9b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 09:18:55.502784 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-fd835113-f8f1-4a3c-acf9-fa1c0e449801 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 12.886984 Jan 24 09:18:55.504045 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 160/320] 10.222.0.113 () {60 vars in 1151 bytes} [Mon Jan 24 09:18:42 2022] POST /compute/v2.1/servers => generated 382 bytes in 12889 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 24 09:18:55.513873 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-e8472840-049b-4db9-8597-6c76e0389c8f tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:55.514609 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-e8472840-049b-4db9-8597-6c76e0389c8f tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: f73fa07f-65bf-45c0-afb7-c5bfb0356243] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:55.577728 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-e8472840-049b-4db9-8597-6c76e0389c8f tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:55.586375 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-e8472840-049b-4db9-8597-6c76e0389c8f tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243" status: 200 len: 1222 microversion: 2.1 time: 0.076342 Jan 24 09:18:55.587692 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 161/321] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:55 2022] GET /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243 => generated 1222 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:55.748119 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-dde9f091-dd98-4f7d-aa76-d07d756ca150 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:55.749184 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-dde9f091-dd98-4f7d-aa76-d07d756ca150 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:55.755411 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-dde9f091-dd98-4f7d-aa76-d07d756ca150 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:55.755869 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-dde9f091-dd98-4f7d-aa76-d07d756ca150 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:55.756657 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-dde9f091-dd98-4f7d-aa76-d07d756ca150 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:55.757100 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-dde9f091-dd98-4f7d-aa76-d07d756ca150 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:55.879041 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-dde9f091-dd98-4f7d-aa76-d07d756ca150 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 25016 microversion: 2.1 time: 0.134377 Jan 24 09:18:55.882941 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 161/322] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:18:55 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 25016 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:18:55.899226 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-955bad87-9efd-434f-a65a-66ee3142428f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:55.900924 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-955bad87-9efd-434f-a65a-66ee3142428f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:55.908247 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-955bad87-9efd-434f-a65a-66ee3142428f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:55.908698 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-955bad87-9efd-434f-a65a-66ee3142428f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:55.909518 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-955bad87-9efd-434f-a65a-66ee3142428f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:55.909957 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-955bad87-9efd-434f-a65a-66ee3142428f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:56.035348 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-955bad87-9efd-434f-a65a-66ee3142428f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 25520 microversion: 2.20 time: 0.140532 Jan 24 09:18:56.035998 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 162/323] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:18:55 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 25520 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:18:56.137954 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-50eb72a8-8dec-42fc-8c9b-29350b42b71d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:56.138818 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-50eb72a8-8dec-42fc-8c9b-29350b42b71d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:56.145644 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-50eb72a8-8dec-42fc-8c9b-29350b42b71d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:56.146107 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-50eb72a8-8dec-42fc-8c9b-29350b42b71d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:56.146895 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-50eb72a8-8dec-42fc-8c9b-29350b42b71d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:56.147332 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-50eb72a8-8dec-42fc-8c9b-29350b42b71d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:56.283820 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-50eb72a8-8dec-42fc-8c9b-29350b42b71d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:56.291300 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-50eb72a8-8dec-42fc-8c9b-29350b42b71d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1525 microversion: 2.1 time: 0.158221 Jan 24 09:18:56.291891 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 162/324] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:56 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1525 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:56.605656 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-3101588d-136a-461a-ac80-dc54dfb03c82 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:56.606395 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-3101588d-136a-461a-ac80-dc54dfb03c82 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: f73fa07f-65bf-45c0-afb7-c5bfb0356243] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:56.613339 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3101588d-136a-461a-ac80-dc54dfb03c82 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:56.613791 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3101588d-136a-461a-ac80-dc54dfb03c82 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:56.614606 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3101588d-136a-461a-ac80-dc54dfb03c82 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:56.615050 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3101588d-136a-461a-ac80-dc54dfb03c82 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:56.679124 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-3101588d-136a-461a-ac80-dc54dfb03c82 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:56.687514 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-3101588d-136a-461a-ac80-dc54dfb03c82 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243" status: 200 len: 1226 microversion: 2.1 time: 0.087617 Jan 24 09:18:56.688317 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 163/325] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:56 2022] GET /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:56.890494 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-d3873aee-5f02-4bdd-babe-63a6d343426a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:56.891467 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-d3873aee-5f02-4bdd-babe-63a6d343426a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:56.897725 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d3873aee-5f02-4bdd-babe-63a6d343426a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:56.899880 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d3873aee-5f02-4bdd-babe-63a6d343426a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:56.900636 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d3873aee-5f02-4bdd-babe-63a6d343426a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:56.901093 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d3873aee-5f02-4bdd-babe-63a6d343426a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:56.993884 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-d3873aee-5f02-4bdd-babe-63a6d343426a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 25573 microversion: 2.1 time: 0.106731 Jan 24 09:18:56.994648 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 163/326] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:18:56 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 25573 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:18:57.047069 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-b7b23cd3-c283-413c-b092-b3c205bab3c1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:57.047984 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-b7b23cd3-c283-413c-b092-b3c205bab3c1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:57.054513 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b7b23cd3-c283-413c-b092-b3c205bab3c1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:57.055446 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b7b23cd3-c283-413c-b092-b3c205bab3c1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:57.056659 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b7b23cd3-c283-413c-b092-b3c205bab3c1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:57.057086 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b7b23cd3-c283-413c-b092-b3c205bab3c1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:57.173188 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-b7b23cd3-c283-413c-b092-b3c205bab3c1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 26059 microversion: 2.20 time: 0.129694 Jan 24 09:18:57.176932 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 164/327] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:18:57 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 26059 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:18:57.308279 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-97c87535-7d73-44c9-bf70-ee94420e5c8e tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:57.308985 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-97c87535-7d73-44c9-bf70-ee94420e5c8e tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:57.315815 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-97c87535-7d73-44c9-bf70-ee94420e5c8e tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:57.316309 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-97c87535-7d73-44c9-bf70-ee94420e5c8e tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:57.317110 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-97c87535-7d73-44c9-bf70-ee94420e5c8e tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:57.317555 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-97c87535-7d73-44c9-bf70-ee94420e5c8e tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:57.460273 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-97c87535-7d73-44c9-bf70-ee94420e5c8e tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:57.468358 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-97c87535-7d73-44c9-bf70-ee94420e5c8e tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1525 microversion: 2.1 time: 0.164040 Jan 24 09:18:57.469568 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 164/328] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:57 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1525 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:57.705084 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-dc2bd542-63b8-44d7-a611-774c59e5e766 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:57.705773 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-dc2bd542-63b8-44d7-a611-774c59e5e766 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: f73fa07f-65bf-45c0-afb7-c5bfb0356243] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:57.713668 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-dc2bd542-63b8-44d7-a611-774c59e5e766 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:57.714058 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-dc2bd542-63b8-44d7-a611-774c59e5e766 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:57.714943 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-dc2bd542-63b8-44d7-a611-774c59e5e766 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:57.715376 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-dc2bd542-63b8-44d7-a611-774c59e5e766 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:57.779951 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-dc2bd542-63b8-44d7-a611-774c59e5e766 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:57.788221 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-dc2bd542-63b8-44d7-a611-774c59e5e766 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243" status: 200 len: 1274 microversion: 2.1 time: 0.087051 Jan 24 09:18:57.788801 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 165/329] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:57 2022] GET /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243 => generated 1274 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:58.014161 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-9c9a6013-e64d-4db5-8857-a0fd19b16ee6 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:58.015016 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-9c9a6013-e64d-4db5-8857-a0fd19b16ee6 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:58.021449 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-9c9a6013-e64d-4db5-8857-a0fd19b16ee6 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:58.021905 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-9c9a6013-e64d-4db5-8857-a0fd19b16ee6 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:58.022967 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-9c9a6013-e64d-4db5-8857-a0fd19b16ee6 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:58.024366 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-9c9a6013-e64d-4db5-8857-a0fd19b16ee6 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:58.128561 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-9c9a6013-e64d-4db5-8857-a0fd19b16ee6 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 26427 microversion: 2.1 time: 0.119275 Jan 24 09:18:58.130626 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 165/330] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:18:58 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 26427 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:18:58.186360 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-8d1ea9f0-1605-4eda-ae3e-abe9f090a58d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:58.187761 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-8d1ea9f0-1605-4eda-ae3e-abe9f090a58d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:58.196092 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8d1ea9f0-1605-4eda-ae3e-abe9f090a58d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:58.197049 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8d1ea9f0-1605-4eda-ae3e-abe9f090a58d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:58.198271 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8d1ea9f0-1605-4eda-ae3e-abe9f090a58d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:58.198918 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8d1ea9f0-1605-4eda-ae3e-abe9f090a58d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:58.332993 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-8d1ea9f0-1605-4eda-ae3e-abe9f090a58d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 26537 microversion: 2.20 time: 0.150594 Jan 24 09:18:58.333751 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 166/331] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:18:58 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 26537 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 09:18:58.489885 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-c50d4fba-6419-4410-9468-856276af8bd1 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:58.490633 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-c50d4fba-6419-4410-9468-856276af8bd1 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:58.498279 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c50d4fba-6419-4410-9468-856276af8bd1 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:58.498729 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c50d4fba-6419-4410-9468-856276af8bd1 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:58.499531 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c50d4fba-6419-4410-9468-856276af8bd1 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:58.499991 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c50d4fba-6419-4410-9468-856276af8bd1 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:58.667012 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-c50d4fba-6419-4410-9468-856276af8bd1 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:58.676390 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-c50d4fba-6419-4410-9468-856276af8bd1 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1525 microversion: 2.1 time: 0.190476 Jan 24 09:18:58.677146 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 166/332] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:58 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1525 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:18:58.806086 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-083a375a-d2ad-42f9-b41a-32a0da92863e tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:58.806912 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-083a375a-d2ad-42f9-b41a-32a0da92863e tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: f73fa07f-65bf-45c0-afb7-c5bfb0356243] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:58.813935 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-083a375a-d2ad-42f9-b41a-32a0da92863e tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:58.814408 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-083a375a-d2ad-42f9-b41a-32a0da92863e tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:58.815369 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-083a375a-d2ad-42f9-b41a-32a0da92863e tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:58.815805 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-083a375a-d2ad-42f9-b41a-32a0da92863e tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:59.093337 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-083a375a-d2ad-42f9-b41a-32a0da92863e tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:59.101383 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-083a375a-d2ad-42f9-b41a-32a0da92863e tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243" status: 200 len: 1322 microversion: 2.1 time: 0.300072 Jan 24 09:18:59.102950 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 167/333] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:58 2022] GET /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243 => generated 1322 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:18:59.140882 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-fea98777-0858-4d41-9783-910092a49fba tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:59.142204 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-fea98777-0858-4d41-9783-910092a49fba tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:59.150278 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fea98777-0858-4d41-9783-910092a49fba tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:59.151047 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fea98777-0858-4d41-9783-910092a49fba tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:59.151949 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fea98777-0858-4d41-9783-910092a49fba tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:59.152736 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fea98777-0858-4d41-9783-910092a49fba tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:59.304428 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-fea98777-0858-4d41-9783-910092a49fba tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 26776 microversion: 2.1 time: 0.168300 Jan 24 09:18:59.305296 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 167/334] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:18:59 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 26776 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:18:59.345025 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-e9d15848-bc9a-4e94-a43a-d017fc297ec1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:59.346055 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-e9d15848-bc9a-4e94-a43a-d017fc297ec1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:59.353228 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e9d15848-bc9a-4e94-a43a-d017fc297ec1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:59.353637 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e9d15848-bc9a-4e94-a43a-d017fc297ec1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:59.354723 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e9d15848-bc9a-4e94-a43a-d017fc297ec1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:59.355152 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e9d15848-bc9a-4e94-a43a-d017fc297ec1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:59.493851 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-e9d15848-bc9a-4e94-a43a-d017fc297ec1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 26929 microversion: 2.20 time: 0.152387 Jan 24 09:18:59.497662 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 168/335] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:18:59 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 26929 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:18:59.657739 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [req-5fc42f89-dfea-4fca-a146-44d9014b5793 req-acca3232-59d1-4778-9d66-86701a1d4b6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f73fa07f-65bf-45c0-afb7-c5bfb0356243", "tag": "03ee32c8-006e-44bb-8ead-c281985d4343"}]} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:18:59.659429 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:18:59.659429 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: warnings.warn(msg) Jan 24 09:18:59.687045 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-5fc42f89-dfea-4fca-a146-44d9014b5793 req-acca3232-59d1-4778-9d66-86701a1d4b6d service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:59.688608 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-5fc42f89-dfea-4fca-a146-44d9014b5793 req-acca3232-59d1-4778-9d66-86701a1d4b6d service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:59.696248 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-8e15c2b2-6d8c-4819-a4ff-17ffe4dcd31f tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:18:59.697881 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-8e15c2b2-6d8c-4819-a4ff-17ffe4dcd31f tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:18:59.706297 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8e15c2b2-6d8c-4819-a4ff-17ffe4dcd31f tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:59.707041 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8e15c2b2-6d8c-4819-a4ff-17ffe4dcd31f tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:59.707845 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8e15c2b2-6d8c-4819-a4ff-17ffe4dcd31f tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:18:59.708450 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8e15c2b2-6d8c-4819-a4ff-17ffe4dcd31f tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:18:59.717915 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.compute.server_external_events [req-5fc42f89-dfea-4fca-a146-44d9014b5793 req-acca3232-59d1-4778-9d66-86701a1d4b6d service nova] Creating event network-changed:03ee32c8-006e-44bb-8ead-c281985d4343 for instance f73fa07f-65bf-45c0-afb7-c5bfb0356243 on hv-cinder-80403 Jan 24 09:18:59.723175 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [req-5fc42f89-dfea-4fca-a146-44d9014b5793 req-acca3232-59d1-4778-9d66-86701a1d4b6d service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070750 Jan 24 09:18:59.724160 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 168/336] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:18:59.939999 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-8e15c2b2-6d8c-4819-a4ff-17ffe4dcd31f tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:18:59.948241 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-8e15c2b2-6d8c-4819-a4ff-17ffe4dcd31f tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1525 microversion: 2.1 time: 0.257382 Jan 24 09:18:59.957629 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 169/337] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:18:59 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1525 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:00.129192 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-da984542-266b-4140-a7bc-5f9608bca272 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:00.130304 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-da984542-266b-4140-a7bc-5f9608bca272 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: f73fa07f-65bf-45c0-afb7-c5bfb0356243] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:00.137392 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-da984542-266b-4140-a7bc-5f9608bca272 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:00.137897 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-da984542-266b-4140-a7bc-5f9608bca272 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:00.146316 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-da984542-266b-4140-a7bc-5f9608bca272 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:00.146316 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-da984542-266b-4140-a7bc-5f9608bca272 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:00.290781 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-da984542-266b-4140-a7bc-5f9608bca272 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:00.297858 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-da984542-266b-4140-a7bc-5f9608bca272 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243" status: 200 len: 1322 microversion: 2.1 time: 0.173436 Jan 24 09:19:00.298451 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 169/338] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:00 2022] GET /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:00.315382 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-0d852455-570b-4984-a911-a60f398c5cfc tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:00.316327 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-0d852455-570b-4984-a911-a60f398c5cfc tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:00.323267 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0d852455-570b-4984-a911-a60f398c5cfc tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:00.323718 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0d852455-570b-4984-a911-a60f398c5cfc tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:00.324496 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0d852455-570b-4984-a911-a60f398c5cfc tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:00.324929 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0d852455-570b-4984-a911-a60f398c5cfc tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:00.419897 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-0d852455-570b-4984-a911-a60f398c5cfc tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 27087 microversion: 2.1 time: 0.107902 Jan 24 09:19:00.420583 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 170/339] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:19:00 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 27087 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:19:00.504908 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-6ef14395-4515-43e4-834b-88fd43bcba25 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:00.505823 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-6ef14395-4515-43e4-834b-88fd43bcba25 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:00.513001 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6ef14395-4515-43e4-834b-88fd43bcba25 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:00.513449 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6ef14395-4515-43e4-834b-88fd43bcba25 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:00.514260 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6ef14395-4515-43e4-834b-88fd43bcba25 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:00.514697 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6ef14395-4515-43e4-834b-88fd43bcba25 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:00.627569 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-6ef14395-4515-43e4-834b-88fd43bcba25 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 27212 microversion: 2.20 time: 0.126106 Jan 24 09:19:00.628679 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 170/340] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:19:00 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 27212 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:19:00.965242 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-5369af04-fedc-4b0e-9a41-1aa538cfd0e2 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:00.965939 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-5369af04-fedc-4b0e-9a41-1aa538cfd0e2 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:00.972865 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5369af04-fedc-4b0e-9a41-1aa538cfd0e2 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:00.973258 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5369af04-fedc-4b0e-9a41-1aa538cfd0e2 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:00.974042 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5369af04-fedc-4b0e-9a41-1aa538cfd0e2 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:00.974517 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5369af04-fedc-4b0e-9a41-1aa538cfd0e2 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:01.112550 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-5369af04-fedc-4b0e-9a41-1aa538cfd0e2 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:01.121677 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-5369af04-fedc-4b0e-9a41-1aa538cfd0e2 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1525 microversion: 2.1 time: 0.160445 Jan 24 09:19:01.122273 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 171/341] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:00 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1525 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:01.314411 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-5277e82f-50d2-4e17-aa5c-7747d83a65df tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:01.315147 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-5277e82f-50d2-4e17-aa5c-7747d83a65df tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: f73fa07f-65bf-45c0-afb7-c5bfb0356243] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:01.322697 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5277e82f-50d2-4e17-aa5c-7747d83a65df tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:01.323151 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5277e82f-50d2-4e17-aa5c-7747d83a65df tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:01.323933 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5277e82f-50d2-4e17-aa5c-7747d83a65df tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:01.324374 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5277e82f-50d2-4e17-aa5c-7747d83a65df tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:01.433349 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-a1a0eb41-3616-493f-af0e-3bb04cbe9c3e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:01.434337 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-a1a0eb41-3616-493f-af0e-3bb04cbe9c3e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:01.443972 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a1a0eb41-3616-493f-af0e-3bb04cbe9c3e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:01.444422 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a1a0eb41-3616-493f-af0e-3bb04cbe9c3e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:01.445214 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a1a0eb41-3616-493f-af0e-3bb04cbe9c3e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:01.445772 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a1a0eb41-3616-493f-af0e-3bb04cbe9c3e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:01.459846 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-5277e82f-50d2-4e17-aa5c-7747d83a65df tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:01.467828 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-5277e82f-50d2-4e17-aa5c-7747d83a65df tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243" status: 200 len: 1322 microversion: 2.1 time: 0.157358 Jan 24 09:19:01.468422 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 171/342] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:01 2022] GET /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:01.553845 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-a1a0eb41-3616-493f-af0e-3bb04cbe9c3e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 27300 microversion: 2.1 time: 0.125444 Jan 24 09:19:01.554617 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 172/343] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:19:01 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 27300 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 09:19:01.639100 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-199c70eb-2060-4235-a0a1-3152688b6859 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:01.640013 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-199c70eb-2060-4235-a0a1-3152688b6859 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:01.646276 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-199c70eb-2060-4235-a0a1-3152688b6859 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:01.646729 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-199c70eb-2060-4235-a0a1-3152688b6859 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:01.647601 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-199c70eb-2060-4235-a0a1-3152688b6859 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:01.648039 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-199c70eb-2060-4235-a0a1-3152688b6859 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:01.802846 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-199c70eb-2060-4235-a0a1-3152688b6859 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 27566 microversion: 2.20 time: 0.167263 Jan 24 09:19:01.803770 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 172/344] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:19:01 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 27566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:19:02.139203 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-d3b11794-0aba-431a-8855-aba0eeb8b509 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:02.139936 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-d3b11794-0aba-431a-8855-aba0eeb8b509 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:02.147323 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d3b11794-0aba-431a-8855-aba0eeb8b509 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:02.147788 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d3b11794-0aba-431a-8855-aba0eeb8b509 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:02.148591 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d3b11794-0aba-431a-8855-aba0eeb8b509 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:02.149025 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d3b11794-0aba-431a-8855-aba0eeb8b509 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:02.303616 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-d3b11794-0aba-431a-8855-aba0eeb8b509 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:02.308506 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-d3b11794-0aba-431a-8855-aba0eeb8b509 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1525 microversion: 2.1 time: 0.173491 Jan 24 09:19:02.310132 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 173/345] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:02 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1525 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:02.486483 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-3e2d8a1d-7807-403f-bf92-00404e7234b5 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:02.487233 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-3e2d8a1d-7807-403f-bf92-00404e7234b5 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: f73fa07f-65bf-45c0-afb7-c5bfb0356243] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:02.494954 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3e2d8a1d-7807-403f-bf92-00404e7234b5 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:02.495402 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3e2d8a1d-7807-403f-bf92-00404e7234b5 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:02.496189 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3e2d8a1d-7807-403f-bf92-00404e7234b5 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:02.496621 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3e2d8a1d-7807-403f-bf92-00404e7234b5 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:02.565049 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-2e62cff4-e52a-483a-8d24-5b2a8621754e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:02.566089 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-2e62cff4-e52a-483a-8d24-5b2a8621754e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:02.573081 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-2e62cff4-e52a-483a-8d24-5b2a8621754e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:02.573530 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-2e62cff4-e52a-483a-8d24-5b2a8621754e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:02.574342 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-2e62cff4-e52a-483a-8d24-5b2a8621754e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:02.574770 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-2e62cff4-e52a-483a-8d24-5b2a8621754e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:02.636955 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-3e2d8a1d-7807-403f-bf92-00404e7234b5 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:02.644495 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-3e2d8a1d-7807-403f-bf92-00404e7234b5 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243" status: 200 len: 1322 microversion: 2.1 time: 0.162134 Jan 24 09:19:02.645081 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 173/346] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:02 2022] GET /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:02.684490 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-2e62cff4-e52a-483a-8d24-5b2a8621754e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 27694 microversion: 2.1 time: 0.123151 Jan 24 09:19:02.685274 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 174/347] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:19:02 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 27694 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 09:19:02.815254 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-cb9af7eb-d613-4334-aca2-8dfc3418c9fc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:02.816149 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-cb9af7eb-d613-4334-aca2-8dfc3418c9fc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:02.823519 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-cb9af7eb-d613-4334-aca2-8dfc3418c9fc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:02.823974 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-cb9af7eb-d613-4334-aca2-8dfc3418c9fc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:02.824795 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-cb9af7eb-d613-4334-aca2-8dfc3418c9fc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:02.825231 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-cb9af7eb-d613-4334-aca2-8dfc3418c9fc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:02.937101 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-cb9af7eb-d613-4334-aca2-8dfc3418c9fc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 27743 microversion: 2.20 time: 0.125325 Jan 24 09:19:02.938362 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 174/348] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:19:02 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 27743 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:19:03.328055 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-c0a37305-03b3-4cae-b8d7-cc19c819f7b3 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:03.328856 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-c0a37305-03b3-4cae-b8d7-cc19c819f7b3 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:03.336958 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c0a37305-03b3-4cae-b8d7-cc19c819f7b3 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:03.337406 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c0a37305-03b3-4cae-b8d7-cc19c819f7b3 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:03.338212 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c0a37305-03b3-4cae-b8d7-cc19c819f7b3 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:03.338653 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c0a37305-03b3-4cae-b8d7-cc19c819f7b3 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:03.480303 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-c0a37305-03b3-4cae-b8d7-cc19c819f7b3 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:03.491473 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-c0a37305-03b3-4cae-b8d7-cc19c819f7b3 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1525 microversion: 2.1 time: 0.167341 Jan 24 09:19:03.492579 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 175/349] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:03 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1525 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:03.662561 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-3af7aade-a024-4d91-9251-d461af0259df tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:03.663272 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-3af7aade-a024-4d91-9251-d461af0259df tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: f73fa07f-65bf-45c0-afb7-c5bfb0356243] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:03.672371 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3af7aade-a024-4d91-9251-d461af0259df tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:03.673030 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3af7aade-a024-4d91-9251-d461af0259df tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:03.674087 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3af7aade-a024-4d91-9251-d461af0259df tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:03.674619 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3af7aade-a024-4d91-9251-d461af0259df tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:03.699044 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-c180ad95-f024-4175-a693-a9fbef56ebcc tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:03.700064 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-c180ad95-f024-4175-a693-a9fbef56ebcc tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:03.709644 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c180ad95-f024-4175-a693-a9fbef56ebcc tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:03.710113 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c180ad95-f024-4175-a693-a9fbef56ebcc tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:03.711089 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c180ad95-f024-4175-a693-a9fbef56ebcc tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:03.711645 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c180ad95-f024-4175-a693-a9fbef56ebcc tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:03.837668 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-3af7aade-a024-4d91-9251-d461af0259df tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:03.845980 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-3af7aade-a024-4d91-9251-d461af0259df tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243" status: 200 len: 1322 microversion: 2.1 time: 0.188508 Jan 24 09:19:03.848031 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 175/350] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:03 2022] GET /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:03.861564 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-c180ad95-f024-4175-a693-a9fbef56ebcc tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 27880 microversion: 2.1 time: 0.167079 Jan 24 09:19:03.862485 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 176/351] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:19:03 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 27880 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:19:03.948087 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-566d0625-dbda-4efb-911b-4e0f9eb5500d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:03.949023 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-566d0625-dbda-4efb-911b-4e0f9eb5500d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:03.955189 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-566d0625-dbda-4efb-911b-4e0f9eb5500d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:03.955632 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-566d0625-dbda-4efb-911b-4e0f9eb5500d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:03.956447 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-566d0625-dbda-4efb-911b-4e0f9eb5500d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:03.956879 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-566d0625-dbda-4efb-911b-4e0f9eb5500d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:04.081640 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-566d0625-dbda-4efb-911b-4e0f9eb5500d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 27922 microversion: 2.20 time: 0.137437 Jan 24 09:19:04.082316 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 176/352] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:19:03 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 27922 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:19:04.510810 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-e86fa9e8-a10b-4a2e-af7c-bbad3e76d274 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:04.511514 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-e86fa9e8-a10b-4a2e-af7c-bbad3e76d274 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:04.518201 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e86fa9e8-a10b-4a2e-af7c-bbad3e76d274 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:04.518657 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e86fa9e8-a10b-4a2e-af7c-bbad3e76d274 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:04.519432 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e86fa9e8-a10b-4a2e-af7c-bbad3e76d274 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:04.519869 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e86fa9e8-a10b-4a2e-af7c-bbad3e76d274 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:04.675677 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-e86fa9e8-a10b-4a2e-af7c-bbad3e76d274 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:04.684475 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-e86fa9e8-a10b-4a2e-af7c-bbad3e76d274 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1525 microversion: 2.1 time: 0.178858 Jan 24 09:19:04.685051 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 177/353] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:04 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1525 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:04.864899 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-d96ab890-3d77-4f65-a915-7dabd366a6d1 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:04.865579 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-d96ab890-3d77-4f65-a915-7dabd366a6d1 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: f73fa07f-65bf-45c0-afb7-c5bfb0356243] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:04.873640 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d96ab890-3d77-4f65-a915-7dabd366a6d1 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:04.874106 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d96ab890-3d77-4f65-a915-7dabd366a6d1 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:04.874233 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-d6ee9dcf-3a40-4b54-b689-c3b52ffbe7e1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:04.874903 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d96ab890-3d77-4f65-a915-7dabd366a6d1 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:04.875301 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-d6ee9dcf-3a40-4b54-b689-c3b52ffbe7e1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:04.875396 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d96ab890-3d77-4f65-a915-7dabd366a6d1 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:04.881475 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d6ee9dcf-3a40-4b54-b689-c3b52ffbe7e1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:04.881930 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d6ee9dcf-3a40-4b54-b689-c3b52ffbe7e1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:04.882744 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d6ee9dcf-3a40-4b54-b689-c3b52ffbe7e1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:04.883985 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d6ee9dcf-3a40-4b54-b689-c3b52ffbe7e1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:05.002286 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-d96ab890-3d77-4f65-a915-7dabd366a6d1 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:05.003114 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-d6ee9dcf-3a40-4b54-b689-c3b52ffbe7e1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 28009 microversion: 2.1 time: 0.132404 Jan 24 09:19:05.003763 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 178/354] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:19:04 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 28009 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 09:19:05.010309 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-d96ab890-3d77-4f65-a915-7dabd366a6d1 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243" status: 200 len: 1322 microversion: 2.1 time: 0.149443 Jan 24 09:19:05.010884 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 177/355] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:04 2022] GET /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:05.094589 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-6ca6b049-966a-460c-bede-da7821362c46 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:05.095637 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-6ca6b049-966a-460c-bede-da7821362c46 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:05.103143 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6ca6b049-966a-460c-bede-da7821362c46 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:05.103700 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6ca6b049-966a-460c-bede-da7821362c46 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:05.104480 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6ca6b049-966a-460c-bede-da7821362c46 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:05.104917 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6ca6b049-966a-460c-bede-da7821362c46 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:05.200910 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-6ca6b049-966a-460c-bede-da7821362c46 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 28036 microversion: 2.20 time: 0.110451 Jan 24 09:19:05.201508 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 179/356] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:19:05 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 28036 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:19:05.702493 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-8ed4dc37-79b0-4770-aadf-90fd38adf625 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:05.703287 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-8ed4dc37-79b0-4770-aadf-90fd38adf625 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:05.710000 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-8ed4dc37-79b0-4770-aadf-90fd38adf625 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:05.710561 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-8ed4dc37-79b0-4770-aadf-90fd38adf625 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:05.711455 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-8ed4dc37-79b0-4770-aadf-90fd38adf625 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:05.712021 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-8ed4dc37-79b0-4770-aadf-90fd38adf625 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:05.853847 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-8ed4dc37-79b0-4770-aadf-90fd38adf625 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:05.863228 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-8ed4dc37-79b0-4770-aadf-90fd38adf625 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1525 microversion: 2.1 time: 0.164278 Jan 24 09:19:05.864380 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 178/357] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:05 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1525 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:05.989560 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [req-7e960ec7-94c8-4152-90d4-24e35de10caa req-ead4cac0-5181-4c42-8340-9d23e62f9862 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f73fa07f-65bf-45c0-afb7-c5bfb0356243", "name": "network-vif-plugged", "status": "completed", "tag": "03ee32c8-006e-44bb-8ead-c281985d4343"}]} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:05.991210 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:19:05.991210 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: warnings.warn(msg) Jan 24 09:19:05.999245 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-7e960ec7-94c8-4152-90d4-24e35de10caa req-ead4cac0-5181-4c42-8340-9d23e62f9862 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:05.999688 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-7e960ec7-94c8-4152-90d4-24e35de10caa req-ead4cac0-5181-4c42-8340-9d23e62f9862 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:06.011149 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.compute.server_external_events [req-7e960ec7-94c8-4152-90d4-24e35de10caa req-ead4cac0-5181-4c42-8340-9d23e62f9862 service nova] Creating event network-vif-plugged:03ee32c8-006e-44bb-8ead-c281985d4343 for instance f73fa07f-65bf-45c0-afb7-c5bfb0356243 on hv-cinder-80403 Jan 24 09:19:06.016060 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [req-7e960ec7-94c8-4152-90d4-24e35de10caa req-ead4cac0-5181-4c42-8340-9d23e62f9862 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030606 Jan 24 09:19:06.016446 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-c3617cf2-c496-49a2-ac58-3e86c0fadbfc tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:06.016954 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 180/358] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 09:19:06.017738 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-c3617cf2-c496-49a2-ac58-3e86c0fadbfc tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:06.025871 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c3617cf2-c496-49a2-ac58-3e86c0fadbfc tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:06.026640 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c3617cf2-c496-49a2-ac58-3e86c0fadbfc tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:06.027440 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c3617cf2-c496-49a2-ac58-3e86c0fadbfc tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:06.027884 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c3617cf2-c496-49a2-ac58-3e86c0fadbfc tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:06.028326 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-d4319bed-6265-42b9-9b99-0eab310cf7d3 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:06.029207 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-d4319bed-6265-42b9-9b99-0eab310cf7d3 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: f73fa07f-65bf-45c0-afb7-c5bfb0356243] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:06.047462 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d4319bed-6265-42b9-9b99-0eab310cf7d3 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:06.048114 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d4319bed-6265-42b9-9b99-0eab310cf7d3 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:06.049178 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d4319bed-6265-42b9-9b99-0eab310cf7d3 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:06.049771 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d4319bed-6265-42b9-9b99-0eab310cf7d3 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:06.204026 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-c3617cf2-c496-49a2-ac58-3e86c0fadbfc tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 28172 microversion: 2.1 time: 0.192144 Jan 24 09:19:06.204844 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 179/359] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:19:06 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 28172 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 09:19:06.213939 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-f0b024e2-608b-4e64-94d3-eebb5d18abe5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:06.214940 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-f0b024e2-608b-4e64-94d3-eebb5d18abe5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:06.221797 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f0b024e2-608b-4e64-94d3-eebb5d18abe5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:06.222282 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f0b024e2-608b-4e64-94d3-eebb5d18abe5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:06.223078 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f0b024e2-608b-4e64-94d3-eebb5d18abe5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:06.223523 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f0b024e2-608b-4e64-94d3-eebb5d18abe5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:06.245971 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-d4319bed-6265-42b9-9b99-0eab310cf7d3 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:06.255222 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-d4319bed-6265-42b9-9b99-0eab310cf7d3 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243" status: 200 len: 1322 microversion: 2.1 time: 0.231801 Jan 24 09:19:06.255810 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 181/360] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:06 2022] GET /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:06.325746 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-f0b024e2-608b-4e64-94d3-eebb5d18abe5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 28285 microversion: 2.20 time: 0.116589 Jan 24 09:19:06.352752 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 180/361] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:19:06 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 28285 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:19:06.880621 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-92df4761-0ae6-454c-921b-645b4c69e560 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:06.881230 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-92df4761-0ae6-454c-921b-645b4c69e560 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:06.887837 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-92df4761-0ae6-454c-921b-645b4c69e560 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:06.888283 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-92df4761-0ae6-454c-921b-645b4c69e560 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:06.889059 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-92df4761-0ae6-454c-921b-645b4c69e560 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:06.889503 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-92df4761-0ae6-454c-921b-645b4c69e560 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:07.058981 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-92df4761-0ae6-454c-921b-645b4c69e560 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:07.066169 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-92df4761-0ae6-454c-921b-645b4c69e560 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1525 microversion: 2.1 time: 0.189189 Jan 24 09:19:07.066625 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 182/362] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:06 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1525 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:07.217261 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-ee05c283-2b4f-42a7-b46c-079f0da25ce5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:07.218305 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-ee05c283-2b4f-42a7-b46c-079f0da25ce5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:07.229366 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ee05c283-2b4f-42a7-b46c-079f0da25ce5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:07.229366 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ee05c283-2b4f-42a7-b46c-079f0da25ce5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:07.229366 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ee05c283-2b4f-42a7-b46c-079f0da25ce5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:07.229366 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ee05c283-2b4f-42a7-b46c-079f0da25ce5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:07.271848 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-1804b929-37ea-425e-a122-888480632a05 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:07.272559 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-1804b929-37ea-425e-a122-888480632a05 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: f73fa07f-65bf-45c0-afb7-c5bfb0356243] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:07.279819 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1804b929-37ea-425e-a122-888480632a05 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:07.280273 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1804b929-37ea-425e-a122-888480632a05 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:07.281061 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1804b929-37ea-425e-a122-888480632a05 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:07.281494 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1804b929-37ea-425e-a122-888480632a05 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:07.421413 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-1804b929-37ea-425e-a122-888480632a05 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:07.428955 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-1804b929-37ea-425e-a122-888480632a05 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243" status: 200 len: 1322 microversion: 2.1 time: 0.160723 Jan 24 09:19:07.429561 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 183/363] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:07 2022] GET /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:19:07.434548 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-e71959db-4d66-4b48-a3a4-5352cfc2686f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:07.437196 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-e71959db-4d66-4b48-a3a4-5352cfc2686f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:07.443318 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e71959db-4d66-4b48-a3a4-5352cfc2686f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:07.443767 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e71959db-4d66-4b48-a3a4-5352cfc2686f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:07.444548 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e71959db-4d66-4b48-a3a4-5352cfc2686f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:07.445336 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e71959db-4d66-4b48-a3a4-5352cfc2686f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:07.457229 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-ee05c283-2b4f-42a7-b46c-079f0da25ce5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 28356 microversion: 2.1 time: 0.244932 Jan 24 09:19:07.458853 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 181/364] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:19:07 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 28356 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:19:07.555507 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-e71959db-4d66-4b48-a3a4-5352cfc2686f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 28285 microversion: 2.20 time: 0.124698 Jan 24 09:19:07.556157 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 184/365] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:19:07 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 28285 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:19:08.083545 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-9e694828-1df7-45c2-a1af-0f6e00b83598 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:08.084332 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-9e694828-1df7-45c2-a1af-0f6e00b83598 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:08.092592 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-9e694828-1df7-45c2-a1af-0f6e00b83598 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:08.093040 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-9e694828-1df7-45c2-a1af-0f6e00b83598 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:08.093849 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-9e694828-1df7-45c2-a1af-0f6e00b83598 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:08.094341 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-9e694828-1df7-45c2-a1af-0f6e00b83598 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:08.243204 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-9e694828-1df7-45c2-a1af-0f6e00b83598 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:08.251587 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-9e694828-1df7-45c2-a1af-0f6e00b83598 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1525 microversion: 2.1 time: 0.172133 Jan 24 09:19:08.252160 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 182/366] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:08 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1525 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:08.449847 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-fa25b658-09f0-4669-bd13-705f88c0d3fe tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:08.450459 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-fa25b658-09f0-4669-bd13-705f88c0d3fe tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: f73fa07f-65bf-45c0-afb7-c5bfb0356243] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:08.457104 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-fa25b658-09f0-4669-bd13-705f88c0d3fe tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:08.457552 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-fa25b658-09f0-4669-bd13-705f88c0d3fe tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:08.458369 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-fa25b658-09f0-4669-bd13-705f88c0d3fe tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:08.458810 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-fa25b658-09f0-4669-bd13-705f88c0d3fe tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:08.470241 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-b5b896d7-3c77-4d2b-9140-783aefa97331 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:08.471157 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-b5b896d7-3c77-4d2b-9140-783aefa97331 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:08.477355 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b5b896d7-3c77-4d2b-9140-783aefa97331 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:08.477810 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b5b896d7-3c77-4d2b-9140-783aefa97331 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:08.478618 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b5b896d7-3c77-4d2b-9140-783aefa97331 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:08.479051 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b5b896d7-3c77-4d2b-9140-783aefa97331 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:08.589866 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-b5b896d7-3c77-4d2b-9140-783aefa97331 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 28356 microversion: 2.1 time: 0.119771 Jan 24 09:19:08.589866 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 183/367] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:19:08 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 28356 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:19:08.593328 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-32cd4e35-ecf6-4931-b5e9-e3d9c37641b6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:08.594371 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-32cd4e35-ecf6-4931-b5e9-e3d9c37641b6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:08.602676 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-32cd4e35-ecf6-4931-b5e9-e3d9c37641b6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:08.603309 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-32cd4e35-ecf6-4931-b5e9-e3d9c37641b6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:08.604300 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-32cd4e35-ecf6-4931-b5e9-e3d9c37641b6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:08.604901 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-32cd4e35-ecf6-4931-b5e9-e3d9c37641b6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:08.619371 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-fa25b658-09f0-4669-bd13-705f88c0d3fe tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:08.629731 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-fa25b658-09f0-4669-bd13-705f88c0d3fe tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243" status: 200 len: 1322 microversion: 2.1 time: 0.185372 Jan 24 09:19:08.630727 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 185/368] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:08 2022] GET /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:08.769533 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-32cd4e35-ecf6-4931-b5e9-e3d9c37641b6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 28285 microversion: 2.20 time: 0.180140 Jan 24 09:19:08.770371 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 184/369] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:19:08 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 28285 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:19:09.268577 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-bcd115d8-7a2d-41c1-9f38-86fbe642aab3 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:09.269189 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-bcd115d8-7a2d-41c1-9f38-86fbe642aab3 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:09.275458 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bcd115d8-7a2d-41c1-9f38-86fbe642aab3 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:09.275916 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bcd115d8-7a2d-41c1-9f38-86fbe642aab3 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:09.276704 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bcd115d8-7a2d-41c1-9f38-86fbe642aab3 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:09.277258 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bcd115d8-7a2d-41c1-9f38-86fbe642aab3 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:09.413605 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-bcd115d8-7a2d-41c1-9f38-86fbe642aab3 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:09.425250 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-bcd115d8-7a2d-41c1-9f38-86fbe642aab3 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1525 microversion: 2.1 time: 0.159251 Jan 24 09:19:09.425250 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 186/370] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:09 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1525 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:09.598444 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-f5355d13-1e7a-42b3-b45d-daa9c38f2a33 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:09.599479 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-f5355d13-1e7a-42b3-b45d-daa9c38f2a33 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:09.608418 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f5355d13-1e7a-42b3-b45d-daa9c38f2a33 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:09.609119 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f5355d13-1e7a-42b3-b45d-daa9c38f2a33 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:09.610207 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f5355d13-1e7a-42b3-b45d-daa9c38f2a33 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:09.610643 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f5355d13-1e7a-42b3-b45d-daa9c38f2a33 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:09.649218 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-24bd0883-634c-44ec-997f-40a52098c7a8 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:09.650614 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-24bd0883-634c-44ec-997f-40a52098c7a8 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: f73fa07f-65bf-45c0-afb7-c5bfb0356243] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:09.657323 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-24bd0883-634c-44ec-997f-40a52098c7a8 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:09.657770 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-24bd0883-634c-44ec-997f-40a52098c7a8 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:09.658614 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-24bd0883-634c-44ec-997f-40a52098c7a8 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:09.659047 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-24bd0883-634c-44ec-997f-40a52098c7a8 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:09.720817 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-f5355d13-1e7a-42b3-b45d-daa9c38f2a33 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 28356 microversion: 2.1 time: 0.126240 Jan 24 09:19:09.721589 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 185/371] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:19:09 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 28356 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:19:09.781472 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-9fd5516b-923a-44a8-8da8-e18547103546 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:09.782508 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-9fd5516b-923a-44a8-8da8-e18547103546 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:09.791634 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-9fd5516b-923a-44a8-8da8-e18547103546 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:09.792088 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-9fd5516b-923a-44a8-8da8-e18547103546 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:09.793576 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-9fd5516b-923a-44a8-8da8-e18547103546 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:09.794157 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-9fd5516b-923a-44a8-8da8-e18547103546 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:09.798991 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-24bd0883-634c-44ec-997f-40a52098c7a8 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:09.806936 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-24bd0883-634c-44ec-997f-40a52098c7a8 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243" status: 200 len: 1512 microversion: 2.1 time: 0.161685 Jan 24 09:19:09.807586 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 187/372] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:09 2022] GET /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243 => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:09.890493 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-9fd5516b-923a-44a8-8da8-e18547103546 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 28285 microversion: 2.20 time: 0.112933 Jan 24 09:19:09.891263 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 186/373] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:19:09 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 28285 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 09:19:10.443584 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-581cd9c3-04c9-42d2-a6b4-0bf0fa374f46 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:10.443584 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-581cd9c3-04c9-42d2-a6b4-0bf0fa374f46 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:10.450759 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-581cd9c3-04c9-42d2-a6b4-0bf0fa374f46 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:10.451335 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-581cd9c3-04c9-42d2-a6b4-0bf0fa374f46 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:10.452373 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-581cd9c3-04c9-42d2-a6b4-0bf0fa374f46 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:10.453142 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-581cd9c3-04c9-42d2-a6b4-0bf0fa374f46 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:10.613724 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-581cd9c3-04c9-42d2-a6b4-0bf0fa374f46 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:10.622065 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-581cd9c3-04c9-42d2-a6b4-0bf0fa374f46 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1505 microversion: 2.1 time: 0.183528 Jan 24 09:19:10.622707 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 188/374] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:10 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1505 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:10.640262 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-ab1beb75-9256-43dc-b59f-9b091da75a33 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:10.640969 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-ab1beb75-9256-43dc-b59f-9b091da75a33 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:10.649722 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ab1beb75-9256-43dc-b59f-9b091da75a33 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:10.649722 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ab1beb75-9256-43dc-b59f-9b091da75a33 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:10.649722 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ab1beb75-9256-43dc-b59f-9b091da75a33 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:10.649722 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ab1beb75-9256-43dc-b59f-9b091da75a33 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:10.732930 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-9adf0ac2-4004-4969-9e80-f158a8fc493f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:10.734555 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-9adf0ac2-4004-4969-9e80-f158a8fc493f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:10.741661 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9adf0ac2-4004-4969-9e80-f158a8fc493f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:10.742369 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9adf0ac2-4004-4969-9e80-f158a8fc493f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:10.743333 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9adf0ac2-4004-4969-9e80-f158a8fc493f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:10.743928 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9adf0ac2-4004-4969-9e80-f158a8fc493f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:10.805165 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-ab1beb75-9256-43dc-b59f-9b091da75a33 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:10.813262 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-ab1beb75-9256-43dc-b59f-9b091da75a33 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1519 microversion: 2.1 time: 0.177911 Jan 24 09:19:10.813843 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 187/375] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:10 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1519 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:10.844887 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-9adf0ac2-4004-4969-9e80-f158a8fc493f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 28356 microversion: 2.1 time: 0.115583 Jan 24 09:19:10.846054 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 189/376] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:19:10 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 28356 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:19:10.905209 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-ccf58e0a-b072-4f9c-984f-0fc6328ccd21 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:10.906838 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-ccf58e0a-b072-4f9c-984f-0fc6328ccd21 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:10.915365 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ccf58e0a-b072-4f9c-984f-0fc6328ccd21 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:10.916065 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ccf58e0a-b072-4f9c-984f-0fc6328ccd21 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:10.917187 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ccf58e0a-b072-4f9c-984f-0fc6328ccd21 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:10.918647 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ccf58e0a-b072-4f9c-984f-0fc6328ccd21 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:11.057833 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-ccf58e0a-b072-4f9c-984f-0fc6328ccd21 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 28285 microversion: 2.20 time: 0.158966 Jan 24 09:19:11.059210 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 188/377] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:19:10 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 28285 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:19:11.461566 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-64f75ea1-8ccc-43ce-85b3-e260ba7cafeb tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce548106-f7b8-4f8a-863d-773cb435719c"}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:11.462921 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-64f75ea1-8ccc-43ce-85b3-e260ba7cafeb tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: f73fa07f-65bf-45c0-afb7-c5bfb0356243] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:11.470154 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-64f75ea1-8ccc-43ce-85b3-e260ba7cafeb tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:11.470804 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-64f75ea1-8ccc-43ce-85b3-e260ba7cafeb tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:11.471590 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-64f75ea1-8ccc-43ce-85b3-e260ba7cafeb tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:11.472059 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-64f75ea1-8ccc-43ce-85b3-e260ba7cafeb tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:11.857780 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-e090a32b-90a2-48ff-aea0-62ead7be8503 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:11.859174 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-e090a32b-90a2-48ff-aea0-62ead7be8503 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:11.866059 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e090a32b-90a2-48ff-aea0-62ead7be8503 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:11.866539 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e090a32b-90a2-48ff-aea0-62ead7be8503 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:11.867336 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e090a32b-90a2-48ff-aea0-62ead7be8503 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:11.867762 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e090a32b-90a2-48ff-aea0-62ead7be8503 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:11.954332 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-e090a32b-90a2-48ff-aea0-62ead7be8503 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 28356 microversion: 2.1 time: 0.100990 Jan 24 09:19:11.954999 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 189/378] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:19:11 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 28356 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 09:19:12.071318 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-8527e10a-55a6-4fcc-a941-2f2619176994 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:12.072460 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-8527e10a-55a6-4fcc-a941-2f2619176994 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:12.079782 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-8527e10a-55a6-4fcc-a941-2f2619176994 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:12.080234 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-8527e10a-55a6-4fcc-a941-2f2619176994 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:12.081057 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-8527e10a-55a6-4fcc-a941-2f2619176994 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:12.081702 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-8527e10a-55a6-4fcc-a941-2f2619176994 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:12.178950 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-8527e10a-55a6-4fcc-a941-2f2619176994 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 28285 microversion: 2.20 time: 0.110271 Jan 24 09:19:12.178950 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 190/379] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:19:12 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 28285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 09:19:12.297029 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-64f75ea1-8ccc-43ce-85b3-e260ba7cafeb tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "POST /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.839150 Jan 24 09:19:12.298193 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 190/380] 10.222.0.113 () {60 vars in 1327 bytes} [Mon Jan 24 09:19:11 2022] POST /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243/os-volume_attachments => generated 194 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:19:12.537636 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-9686de02-2f52-4218-829d-5b54a1f9efb4 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:12.538804 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-9686de02-2f52-4218-829d-5b54a1f9efb4 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:12.547585 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-9686de02-2f52-4218-829d-5b54a1f9efb4 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:12.548056 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-9686de02-2f52-4218-829d-5b54a1f9efb4 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:12.548929 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-9686de02-2f52-4218-829d-5b54a1f9efb4 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:12.549378 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-9686de02-2f52-4218-829d-5b54a1f9efb4 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:12.584316 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.objects.instance [None req-9686de02-2f52-4218-829d-5b54a1f9efb4 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lazy-loading 'flavor' on Instance uuid 047cd9d3-84f2-4cb0-a2ff-1439420b4f84 {{(pid=116864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 09:19:12.922667 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-9686de02-2f52-4218-829d-5b54a1f9efb4 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "POST /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84/action" status: 200 len: 32 microversion: 2.1 time: 0.389276 Jan 24 09:19:12.927162 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 191/381] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:19:12 2022] POST /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84/action => generated 32 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 09:19:12.936885 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-7fdbdd52-af6a-43ab-9e3b-f03ba696beaf tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:12.937594 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-7fdbdd52-af6a-43ab-9e3b-f03ba696beaf tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:12.943791 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7fdbdd52-af6a-43ab-9e3b-f03ba696beaf tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:12.944256 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7fdbdd52-af6a-43ab-9e3b-f03ba696beaf tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:12.952045 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7fdbdd52-af6a-43ab-9e3b-f03ba696beaf tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:12.952045 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7fdbdd52-af6a-43ab-9e3b-f03ba696beaf tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:12.968990 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-e4689d46-f1b4-4347-bb32-14920e503708 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:12.970014 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-e4689d46-f1b4-4347-bb32-14920e503708 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:12.978296 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e4689d46-f1b4-4347-bb32-14920e503708 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:12.978765 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e4689d46-f1b4-4347-bb32-14920e503708 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:12.979749 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e4689d46-f1b4-4347-bb32-14920e503708 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:12.980340 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e4689d46-f1b4-4347-bb32-14920e503708 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:13.093299 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-e4689d46-f1b4-4347-bb32-14920e503708 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 28356 microversion: 2.1 time: 0.130570 Jan 24 09:19:13.094345 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 192/382] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:19:12 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 28356 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:19:13.154134 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-7fdbdd52-af6a-43ab-9e3b-f03ba696beaf tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:13.162632 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-7fdbdd52-af6a-43ab-9e3b-f03ba696beaf tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1525 microversion: 2.1 time: 0.231007 Jan 24 09:19:13.168211 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 191/383] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:12 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1525 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:13.191693 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-2c5222c0-99f9-47f1-a6fc-058769969545 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:13.196998 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-2c5222c0-99f9-47f1-a6fc-058769969545 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:13.200038 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2c5222c0-99f9-47f1-a6fc-058769969545 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:13.201373 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2c5222c0-99f9-47f1-a6fc-058769969545 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:13.202424 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2c5222c0-99f9-47f1-a6fc-058769969545 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:13.203050 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2c5222c0-99f9-47f1-a6fc-058769969545 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:13.334955 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-2c5222c0-99f9-47f1-a6fc-058769969545 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 28300 microversion: 2.20 time: 0.146564 Jan 24 09:19:13.334955 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 193/384] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:19:13 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 28300 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:19:14.107788 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-d1904b2a-cbcd-4b4d-b6bc-7f16324b076c tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:14.108826 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-d1904b2a-cbcd-4b4d-b6bc-7f16324b076c tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:14.115118 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d1904b2a-cbcd-4b4d-b6bc-7f16324b076c tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:14.115580 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d1904b2a-cbcd-4b4d-b6bc-7f16324b076c tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:14.116344 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d1904b2a-cbcd-4b4d-b6bc-7f16324b076c tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:14.116776 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d1904b2a-cbcd-4b4d-b6bc-7f16324b076c tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:14.184495 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-9f68df2c-c98e-4ab0-8ab3-b262e28a4a85 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:14.186265 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-9f68df2c-c98e-4ab0-8ab3-b262e28a4a85 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:14.193140 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-9f68df2c-c98e-4ab0-8ab3-b262e28a4a85 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:14.193594 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-9f68df2c-c98e-4ab0-8ab3-b262e28a4a85 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:14.194405 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-9f68df2c-c98e-4ab0-8ab3-b262e28a4a85 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:14.194842 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-9f68df2c-c98e-4ab0-8ab3-b262e28a4a85 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:14.329708 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-9f68df2c-c98e-4ab0-8ab3-b262e28a4a85 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:14.336979 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-9f68df2c-c98e-4ab0-8ab3-b262e28a4a85 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1525 microversion: 2.1 time: 0.156586 Jan 24 09:19:14.338871 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 194/385] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:14 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1525 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:19:14.343990 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-60e9667f-5b74-42f2-90ff-c2a338d60888 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:14.358076 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-60e9667f-5b74-42f2-90ff-c2a338d60888 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:14.358076 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-60e9667f-5b74-42f2-90ff-c2a338d60888 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:14.358076 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-60e9667f-5b74-42f2-90ff-c2a338d60888 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:14.358076 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-60e9667f-5b74-42f2-90ff-c2a338d60888 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:14.358479 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-60e9667f-5b74-42f2-90ff-c2a338d60888 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:16.916226 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-d1904b2a-cbcd-4b4d-b6bc-7f16324b076c tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 28641 microversion: 2.1 time: 2.814251 Jan 24 09:19:16.917138 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 192/386] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:19:14 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 28641 bytes in 2816 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:19:16.922878 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-be2f4faa-da73-4818-a137-5c4ec2a7a62d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:16.923578 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-be2f4faa-da73-4818-a137-5c4ec2a7a62d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:16.930379 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-be2f4faa-da73-4818-a137-5c4ec2a7a62d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:16.930835 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-be2f4faa-da73-4818-a137-5c4ec2a7a62d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:16.931627 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-be2f4faa-da73-4818-a137-5c4ec2a7a62d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:16.932158 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-be2f4faa-da73-4818-a137-5c4ec2a7a62d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:16.944263 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-60e9667f-5b74-42f2-90ff-c2a338d60888 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 28572 microversion: 2.20 time: 2.603344 Jan 24 09:19:16.944926 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 195/387] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:19:14 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 28572 bytes in 2605 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 09:19:17.182594 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-be2f4faa-da73-4818-a137-5c4ec2a7a62d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:17.191019 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-be2f4faa-da73-4818-a137-5c4ec2a7a62d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1525 microversion: 2.1 time: 0.272557 Jan 24 09:19:17.191842 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 193/388] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:16 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1525 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:17.929739 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-e92510dc-b573-42d1-8e55-d6c18e3b56d1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:17.930718 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-e92510dc-b573-42d1-8e55-d6c18e3b56d1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:17.938339 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e92510dc-b573-42d1-8e55-d6c18e3b56d1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:17.938785 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e92510dc-b573-42d1-8e55-d6c18e3b56d1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:17.939571 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e92510dc-b573-42d1-8e55-d6c18e3b56d1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:17.940018 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e92510dc-b573-42d1-8e55-d6c18e3b56d1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:17.957168 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-1dfeb5d6-d780-4e6a-9a70-38febe661279 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:17.958301 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-1dfeb5d6-d780-4e6a-9a70-38febe661279 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:17.964798 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1dfeb5d6-d780-4e6a-9a70-38febe661279 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:17.965248 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1dfeb5d6-d780-4e6a-9a70-38febe661279 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:17.966032 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1dfeb5d6-d780-4e6a-9a70-38febe661279 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:17.967138 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1dfeb5d6-d780-4e6a-9a70-38febe661279 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:21.663249 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-1dfeb5d6-d780-4e6a-9a70-38febe661279 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 28934 microversion: 2.20 time: 3.709823 Jan 24 09:19:21.663945 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 194/389] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:19:17 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 28934 bytes in 3711 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 09:19:21.668645 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-e68668af-5658-4661-8a0a-cf9ad3b3937c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:21.669340 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-e68668af-5658-4661-8a0a-cf9ad3b3937c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:21.677157 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e68668af-5658-4661-8a0a-cf9ad3b3937c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:21.677862 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e68668af-5658-4661-8a0a-cf9ad3b3937c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:21.678697 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e68668af-5658-4661-8a0a-cf9ad3b3937c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:21.679130 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e68668af-5658-4661-8a0a-cf9ad3b3937c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:21.690635 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-e92510dc-b573-42d1-8e55-d6c18e3b56d1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 29010 microversion: 2.1 time: 3.765218 Jan 24 09:19:21.694708 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 196/390] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:19:17 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 29010 bytes in 3767 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:19:21.819772 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-e68668af-5658-4661-8a0a-cf9ad3b3937c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:21.828035 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-e68668af-5658-4661-8a0a-cf9ad3b3937c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1525 microversion: 2.1 time: 0.162285 Jan 24 09:19:21.828852 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 195/391] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:21 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1525 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:22.675913 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-7e9792d8-96ae-46d7-817a-c354c947a869 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:22.677820 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-7e9792d8-96ae-46d7-817a-c354c947a869 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:22.685741 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-7e9792d8-96ae-46d7-817a-c354c947a869 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:22.686287 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-7e9792d8-96ae-46d7-817a-c354c947a869 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:22.687226 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-7e9792d8-96ae-46d7-817a-c354c947a869 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:22.687867 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-7e9792d8-96ae-46d7-817a-c354c947a869 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:22.702887 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-491cf046-8ca1-4ef3-8468-93212d63bb1d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:22.708861 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-491cf046-8ca1-4ef3-8468-93212d63bb1d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:22.711447 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-491cf046-8ca1-4ef3-8468-93212d63bb1d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:22.712137 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-491cf046-8ca1-4ef3-8468-93212d63bb1d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:22.713377 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-491cf046-8ca1-4ef3-8468-93212d63bb1d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:22.714216 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-491cf046-8ca1-4ef3-8468-93212d63bb1d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:22.814114 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-7e9792d8-96ae-46d7-817a-c354c947a869 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 28934 microversion: 2.20 time: 0.142971 Jan 24 09:19:22.815045 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 197/392] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:19:22 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 28934 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:19:22.835293 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-491cf046-8ca1-4ef3-8468-93212d63bb1d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 29010 microversion: 2.1 time: 0.136945 Jan 24 09:19:22.848263 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 196/393] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:19:22 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 29010 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:19:22.851977 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-618b3abe-8417-4869-ac89-c7a8c94007bd tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:22.853045 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-618b3abe-8417-4869-ac89-c7a8c94007bd tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:22.860511 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-618b3abe-8417-4869-ac89-c7a8c94007bd tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:22.860985 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-618b3abe-8417-4869-ac89-c7a8c94007bd tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:22.861815 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-618b3abe-8417-4869-ac89-c7a8c94007bd tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:22.862415 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-618b3abe-8417-4869-ac89-c7a8c94007bd tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:23.022613 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-618b3abe-8417-4869-ac89-c7a8c94007bd tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:23.038519 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-618b3abe-8417-4869-ac89-c7a8c94007bd tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1525 microversion: 2.1 time: 0.190497 Jan 24 09:19:23.039119 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 198/394] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:22 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1525 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:23.825922 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-a4351f14-1a3f-4d24-8238-66f7515dd6fe tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:23.827015 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-a4351f14-1a3f-4d24-8238-66f7515dd6fe tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:23.833778 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a4351f14-1a3f-4d24-8238-66f7515dd6fe tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:23.834264 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a4351f14-1a3f-4d24-8238-66f7515dd6fe tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:23.835047 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a4351f14-1a3f-4d24-8238-66f7515dd6fe tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:23.835476 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a4351f14-1a3f-4d24-8238-66f7515dd6fe tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:23.856059 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-bcc0abc9-139f-4e8f-b17b-ec74bcbb186d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:23.857621 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-bcc0abc9-139f-4e8f-b17b-ec74bcbb186d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:23.865323 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-bcc0abc9-139f-4e8f-b17b-ec74bcbb186d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:23.865860 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-bcc0abc9-139f-4e8f-b17b-ec74bcbb186d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:23.866801 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-bcc0abc9-139f-4e8f-b17b-ec74bcbb186d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:23.867237 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-bcc0abc9-139f-4e8f-b17b-ec74bcbb186d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:23.945174 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-a4351f14-1a3f-4d24-8238-66f7515dd6fe tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 28934 microversion: 2.20 time: 0.123415 Jan 24 09:19:23.945937 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 197/395] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:19:23 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 28934 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:19:23.956026 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-bcc0abc9-139f-4e8f-b17b-ec74bcbb186d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 29010 microversion: 2.1 time: 0.102958 Jan 24 09:19:23.957090 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 199/396] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:19:23 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 29010 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 09:19:24.059513 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-893d36c5-d468-4290-8d5b-075d37c6313b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:24.060840 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-893d36c5-d468-4290-8d5b-075d37c6313b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:24.072017 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-893d36c5-d468-4290-8d5b-075d37c6313b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:24.072693 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-893d36c5-d468-4290-8d5b-075d37c6313b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:24.074241 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-893d36c5-d468-4290-8d5b-075d37c6313b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:24.074827 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-893d36c5-d468-4290-8d5b-075d37c6313b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:24.227223 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-893d36c5-d468-4290-8d5b-075d37c6313b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:24.235279 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-893d36c5-d468-4290-8d5b-075d37c6313b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1525 microversion: 2.1 time: 0.182041 Jan 24 09:19:24.235913 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 198/397] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:24 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1525 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:24.958787 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-4c38a41c-8fb6-4c39-b844-a84ed9b046db tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:24.959791 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-4c38a41c-8fb6-4c39-b844-a84ed9b046db tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:24.967016 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4c38a41c-8fb6-4c39-b844-a84ed9b046db tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:24.967385 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4c38a41c-8fb6-4c39-b844-a84ed9b046db tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:24.968588 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4c38a41c-8fb6-4c39-b844-a84ed9b046db tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:24.968988 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-2a000967-a25b-40fe-a3df-5b3a23ad897a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:24.969426 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4c38a41c-8fb6-4c39-b844-a84ed9b046db tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:24.970117 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-2a000967-a25b-40fe-a3df-5b3a23ad897a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:24.977160 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-2a000967-a25b-40fe-a3df-5b3a23ad897a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:24.977601 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-2a000967-a25b-40fe-a3df-5b3a23ad897a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:24.978599 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-2a000967-a25b-40fe-a3df-5b3a23ad897a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:24.979064 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-2a000967-a25b-40fe-a3df-5b3a23ad897a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:25.064910 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-4c38a41c-8fb6-4c39-b844-a84ed9b046db tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 28934 microversion: 2.20 time: 0.110167 Jan 24 09:19:25.066843 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 200/398] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:19:24 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 28934 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:19:25.076467 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-2a000967-a25b-40fe-a3df-5b3a23ad897a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 29010 microversion: 2.1 time: 0.111453 Jan 24 09:19:25.077003 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 199/399] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:19:24 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 29010 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:19:25.255461 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-7e505952-895f-4126-aaa2-dcf56bf7dc34 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:25.256627 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-7e505952-895f-4126-aaa2-dcf56bf7dc34 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:25.268367 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-7e505952-895f-4126-aaa2-dcf56bf7dc34 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:25.270366 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-7e505952-895f-4126-aaa2-dcf56bf7dc34 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:25.271599 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-7e505952-895f-4126-aaa2-dcf56bf7dc34 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:25.272605 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-7e505952-895f-4126-aaa2-dcf56bf7dc34 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:25.424943 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-7e505952-895f-4126-aaa2-dcf56bf7dc34 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:25.437517 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-7e505952-895f-4126-aaa2-dcf56bf7dc34 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1525 microversion: 2.1 time: 0.185401 Jan 24 09:19:25.437517 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 201/400] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:25 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1525 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:26.083055 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-7994ad4d-7732-4793-8c9a-5e2fdd56df79 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:26.084158 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-7994ad4d-7732-4793-8c9a-5e2fdd56df79 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:26.089548 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-bd8353e8-134f-41ed-a3b4-307139bf5324 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:26.090636 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-bd8353e8-134f-41ed-a3b4-307139bf5324 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:26.091325 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7994ad4d-7732-4793-8c9a-5e2fdd56df79 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:26.091776 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7994ad4d-7732-4793-8c9a-5e2fdd56df79 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:26.092597 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7994ad4d-7732-4793-8c9a-5e2fdd56df79 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:26.093033 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7994ad4d-7732-4793-8c9a-5e2fdd56df79 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:26.097427 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-bd8353e8-134f-41ed-a3b4-307139bf5324 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:26.098040 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-bd8353e8-134f-41ed-a3b4-307139bf5324 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:26.098863 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-bd8353e8-134f-41ed-a3b4-307139bf5324 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:26.099321 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-bd8353e8-134f-41ed-a3b4-307139bf5324 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:26.189717 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-bd8353e8-134f-41ed-a3b4-307139bf5324 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 29010 microversion: 2.1 time: 0.104061 Jan 24 09:19:26.190588 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 202/401] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:19:26 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 29010 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 09:19:26.198908 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-7994ad4d-7732-4793-8c9a-5e2fdd56df79 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 28934 microversion: 2.20 time: 0.118540 Jan 24 09:19:26.198908 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 200/402] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:19:26 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 28934 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:19:26.457976 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-fc859c00-9a57-4291-9892-cc9512073e1e tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:26.459586 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-fc859c00-9a57-4291-9892-cc9512073e1e tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:26.471035 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fc859c00-9a57-4291-9892-cc9512073e1e tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:26.471860 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fc859c00-9a57-4291-9892-cc9512073e1e tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:26.473282 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fc859c00-9a57-4291-9892-cc9512073e1e tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:26.474043 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fc859c00-9a57-4291-9892-cc9512073e1e tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:26.636018 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-fc859c00-9a57-4291-9892-cc9512073e1e tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:26.644379 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-fc859c00-9a57-4291-9892-cc9512073e1e tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1525 microversion: 2.1 time: 0.194120 Jan 24 09:19:26.644979 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 203/403] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:26 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1525 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:27.204226 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-7aa38808-0bc2-4bed-898e-675e502500f1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:27.205298 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-7aa38808-0bc2-4bed-898e-675e502500f1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:27.213853 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7aa38808-0bc2-4bed-898e-675e502500f1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:27.214332 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7aa38808-0bc2-4bed-898e-675e502500f1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:27.215230 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7aa38808-0bc2-4bed-898e-675e502500f1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:27.215942 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7aa38808-0bc2-4bed-898e-675e502500f1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:27.216120 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-9ef4f647-a320-4e2e-aa7f-9d0a71a79943 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:27.218876 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-9ef4f647-a320-4e2e-aa7f-9d0a71a79943 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:27.229597 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-9ef4f647-a320-4e2e-aa7f-9d0a71a79943 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:27.230337 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-9ef4f647-a320-4e2e-aa7f-9d0a71a79943 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:27.233161 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-9ef4f647-a320-4e2e-aa7f-9d0a71a79943 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:27.234531 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-9ef4f647-a320-4e2e-aa7f-9d0a71a79943 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:27.334631 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-7aa38808-0bc2-4bed-898e-675e502500f1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 29010 microversion: 2.1 time: 0.135363 Jan 24 09:19:27.337103 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 201/404] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:19:27 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 29010 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:19:27.364327 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-9ef4f647-a320-4e2e-aa7f-9d0a71a79943 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 28934 microversion: 2.20 time: 0.154014 Jan 24 09:19:27.365220 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 204/405] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:19:27 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 28934 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:19:27.664167 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-a7e20443-01ed-4008-9aaf-95d179ae27bf tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:27.664875 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-a7e20443-01ed-4008-9aaf-95d179ae27bf tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:27.672369 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a7e20443-01ed-4008-9aaf-95d179ae27bf tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:27.672826 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a7e20443-01ed-4008-9aaf-95d179ae27bf tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:27.673628 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a7e20443-01ed-4008-9aaf-95d179ae27bf tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:27.674053 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a7e20443-01ed-4008-9aaf-95d179ae27bf tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:27.859430 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-a7e20443-01ed-4008-9aaf-95d179ae27bf tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:27.869698 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-a7e20443-01ed-4008-9aaf-95d179ae27bf tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1525 microversion: 2.1 time: 0.210129 Jan 24 09:19:27.870351 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 202/406] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:27 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1525 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:19:28.347959 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-23b43651-ef1f-424d-9e1f-01fc1775e866 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:28.350061 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-23b43651-ef1f-424d-9e1f-01fc1775e866 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:28.357204 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-23b43651-ef1f-424d-9e1f-01fc1775e866 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:28.358718 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-23b43651-ef1f-424d-9e1f-01fc1775e866 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:28.359906 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-23b43651-ef1f-424d-9e1f-01fc1775e866 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:28.360564 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-23b43651-ef1f-424d-9e1f-01fc1775e866 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:28.386057 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-4bbc72c7-e8ca-44a9-ba47-69acc7bd114b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:28.386984 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-4bbc72c7-e8ca-44a9-ba47-69acc7bd114b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:28.393734 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4bbc72c7-e8ca-44a9-ba47-69acc7bd114b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:28.394215 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4bbc72c7-e8ca-44a9-ba47-69acc7bd114b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:28.394998 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4bbc72c7-e8ca-44a9-ba47-69acc7bd114b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:28.395635 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4bbc72c7-e8ca-44a9-ba47-69acc7bd114b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:28.484393 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-23b43651-ef1f-424d-9e1f-01fc1775e866 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 29010 microversion: 2.1 time: 0.139711 Jan 24 09:19:28.485352 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 205/407] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:19:28 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 29010 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:19:28.506920 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-4bbc72c7-e8ca-44a9-ba47-69acc7bd114b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 28934 microversion: 2.20 time: 0.124703 Jan 24 09:19:28.507676 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 203/408] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:19:28 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 28934 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 09:19:28.891121 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-ff533e16-923a-4c38-bfcd-b677ca3191df tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:28.892072 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-ff533e16-923a-4c38-bfcd-b677ca3191df tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:28.898948 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ff533e16-923a-4c38-bfcd-b677ca3191df tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:28.899397 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ff533e16-923a-4c38-bfcd-b677ca3191df tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:28.900173 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ff533e16-923a-4c38-bfcd-b677ca3191df tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:28.900605 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ff533e16-923a-4c38-bfcd-b677ca3191df tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:29.273989 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-ff533e16-923a-4c38-bfcd-b677ca3191df tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:29.282486 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-ff533e16-923a-4c38-bfcd-b677ca3191df tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1525 microversion: 2.1 time: 0.395990 Jan 24 09:19:29.283151 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 206/409] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:28 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1525 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:29.496000 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-aa17de80-3933-4719-87e7-8b91f4c03b2a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:29.497007 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-aa17de80-3933-4719-87e7-8b91f4c03b2a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:29.504354 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-aa17de80-3933-4719-87e7-8b91f4c03b2a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:29.504801 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-aa17de80-3933-4719-87e7-8b91f4c03b2a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:29.505576 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-aa17de80-3933-4719-87e7-8b91f4c03b2a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:29.506012 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-aa17de80-3933-4719-87e7-8b91f4c03b2a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:29.520764 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-fd1976dd-4a76-4e61-b8ac-836d753e43a6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:29.521983 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-fd1976dd-4a76-4e61-b8ac-836d753e43a6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:29.527960 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fd1976dd-4a76-4e61-b8ac-836d753e43a6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:29.528403 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fd1976dd-4a76-4e61-b8ac-836d753e43a6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:29.529236 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fd1976dd-4a76-4e61-b8ac-836d753e43a6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:29.529665 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fd1976dd-4a76-4e61-b8ac-836d753e43a6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:29.605190 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-aa17de80-3933-4719-87e7-8b91f4c03b2a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 29010 microversion: 2.1 time: 0.112905 Jan 24 09:19:29.605852 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 204/410] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:19:29 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 29010 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:19:29.648074 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-fd1976dd-4a76-4e61-b8ac-836d753e43a6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 28934 microversion: 2.20 time: 0.131425 Jan 24 09:19:29.648990 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 207/411] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:19:29 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 28934 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 09:19:30.047378 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-49022ac6-1ed1-4dd5-a380-ea55fd97d00b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce548106-f7b8-4f8a-863d-773cb435719c"}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:30.048766 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-49022ac6-1ed1-4dd5-a380-ea55fd97d00b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: f73fa07f-65bf-45c0-afb7-c5bfb0356243] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:30.056133 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-49022ac6-1ed1-4dd5-a380-ea55fd97d00b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:30.056662 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-49022ac6-1ed1-4dd5-a380-ea55fd97d00b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:30.057520 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-49022ac6-1ed1-4dd5-a380-ea55fd97d00b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:30.057963 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-49022ac6-1ed1-4dd5-a380-ea55fd97d00b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:30.138058 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.wsgi [None req-49022ac6-1ed1-4dd5-a380-ea55fd97d00b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] HTTP exception thrown: Invalid volume: volume ce548106-f7b8-4f8a-863d-773cb435719c is already attached to instances: f73fa07f-65bf-45c0-afb7-c5bfb0356243 Jan 24 09:19:30.138684 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-49022ac6-1ed1-4dd5-a380-ea55fd97d00b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Returning 400 to user: Invalid volume: volume ce548106-f7b8-4f8a-863d-773cb435719c is already attached to instances: f73fa07f-65bf-45c0-afb7-c5bfb0356243 {{(pid=116863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:19:30.140144 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-49022ac6-1ed1-4dd5-a380-ea55fd97d00b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "POST /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097110 Jan 24 09:19:30.140719 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 205/412] 10.222.0.113 () {60 vars in 1327 bytes} [Mon Jan 24 09:19:30 2022] POST /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 24 09:19:30.199600 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-3e33b492-d558-4dd5-8bb2-b4d3198940c1 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:30.200184 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-3e33b492-d558-4dd5-8bb2-b4d3198940c1 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: f73fa07f-65bf-45c0-afb7-c5bfb0356243] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:30.207248 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3e33b492-d558-4dd5-8bb2-b4d3198940c1 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:30.207831 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3e33b492-d558-4dd5-8bb2-b4d3198940c1 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:30.208695 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3e33b492-d558-4dd5-8bb2-b4d3198940c1 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:30.209134 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3e33b492-d558-4dd5-8bb2-b4d3198940c1 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:30.299474 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-1f0b671f-9e19-4fcd-8054-6726bc3a5d1e tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:30.300087 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-1f0b671f-9e19-4fcd-8054-6726bc3a5d1e tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:30.307443 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1f0b671f-9e19-4fcd-8054-6726bc3a5d1e tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:30.307898 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1f0b671f-9e19-4fcd-8054-6726bc3a5d1e tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:30.308680 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1f0b671f-9e19-4fcd-8054-6726bc3a5d1e tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:30.309299 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1f0b671f-9e19-4fcd-8054-6726bc3a5d1e tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:30.335286 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.objects.instance [None req-3e33b492-d558-4dd5-8bb2-b4d3198940c1 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lazy-loading 'services' on Instance uuid f73fa07f-65bf-45c0-afb7-c5bfb0356243 {{(pid=116864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 09:19:30.460820 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-1f0b671f-9e19-4fcd-8054-6726bc3a5d1e tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:30.468640 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-1f0b671f-9e19-4fcd-8054-6726bc3a5d1e tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1525 microversion: 2.1 time: 0.173238 Jan 24 09:19:30.469220 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 206/413] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:30 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1525 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:19:30.590675 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-3e33b492-d558-4dd5-8bb2-b4d3198940c1 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "DELETE /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243/os-volume_attachments/ce548106-f7b8-4f8a-863d-773cb435719c" status: 202 len: 0 microversion: 2.1 time: 0.394978 Jan 24 09:19:30.591402 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 208/414] 10.222.0.113 () {58 vars in 1420 bytes} [Mon Jan 24 09:19:30 2022] DELETE /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243/os-volume_attachments/ce548106-f7b8-4f8a-863d-773cb435719c => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:19:30.600181 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-957e6f51-afdc-4043-8704-27738a044f1b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:30.601199 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-957e6f51-afdc-4043-8704-27738a044f1b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: f73fa07f-65bf-45c0-afb7-c5bfb0356243] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:30.607635 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-957e6f51-afdc-4043-8704-27738a044f1b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:30.608775 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-957e6f51-afdc-4043-8704-27738a044f1b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:30.609991 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-957e6f51-afdc-4043-8704-27738a044f1b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:30.610540 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-957e6f51-afdc-4043-8704-27738a044f1b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:30.618704 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-f215debf-3b0f-41ed-a542-822fd7d89bf3 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:30.620522 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-f215debf-3b0f-41ed-a542-822fd7d89bf3 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:30.631580 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f215debf-3b0f-41ed-a542-822fd7d89bf3 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:30.632492 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f215debf-3b0f-41ed-a542-822fd7d89bf3 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:30.633453 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f215debf-3b0f-41ed-a542-822fd7d89bf3 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:30.634187 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f215debf-3b0f-41ed-a542-822fd7d89bf3 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:30.644823 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-957e6f51-afdc-4043-8704-27738a044f1b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048342 Jan 24 09:19:30.645400 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 207/415] 10.222.0.113 () {58 vars in 1306 bytes} [Mon Jan 24 09:19:30 2022] GET /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:19:30.659871 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-3e5a755a-6b4c-422a-8fb7-d09f589117b0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:30.660791 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-3e5a755a-6b4c-422a-8fb7-d09f589117b0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:30.666962 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3e5a755a-6b4c-422a-8fb7-d09f589117b0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:30.667419 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3e5a755a-6b4c-422a-8fb7-d09f589117b0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:30.668238 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3e5a755a-6b4c-422a-8fb7-d09f589117b0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:30.668678 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3e5a755a-6b4c-422a-8fb7-d09f589117b0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:30.797402 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-3e5a755a-6b4c-422a-8fb7-d09f589117b0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 28934 microversion: 2.20 time: 0.139546 Jan 24 09:19:30.798016 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 208/416] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:19:30 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 28934 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 09:19:30.803253 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-f215debf-3b0f-41ed-a542-822fd7d89bf3 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 29010 microversion: 2.1 time: 0.188515 Jan 24 09:19:30.803915 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 209/417] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:19:30 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 29010 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:19:31.485650 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-404f2c6f-6e4a-4651-bd13-aee4178ca321 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:31.486417 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-404f2c6f-6e4a-4651-bd13-aee4178ca321 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:31.493324 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-404f2c6f-6e4a-4651-bd13-aee4178ca321 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:31.493774 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-404f2c6f-6e4a-4651-bd13-aee4178ca321 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:31.494575 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-404f2c6f-6e4a-4651-bd13-aee4178ca321 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:31.495017 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-404f2c6f-6e4a-4651-bd13-aee4178ca321 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:31.644185 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-404f2c6f-6e4a-4651-bd13-aee4178ca321 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:31.653727 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-404f2c6f-6e4a-4651-bd13-aee4178ca321 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1525 microversion: 2.1 time: 0.172293 Jan 24 09:19:31.655679 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 209/418] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:31 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1525 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:31.671346 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-22f54140-2e6c-4e72-8a3a-81216c09636c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:31.673337 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-22f54140-2e6c-4e72-8a3a-81216c09636c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: f73fa07f-65bf-45c0-afb7-c5bfb0356243] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:31.684621 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-22f54140-2e6c-4e72-8a3a-81216c09636c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:31.685183 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-22f54140-2e6c-4e72-8a3a-81216c09636c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:31.686498 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-22f54140-2e6c-4e72-8a3a-81216c09636c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:31.687212 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-22f54140-2e6c-4e72-8a3a-81216c09636c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:31.722485 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-22f54140-2e6c-4e72-8a3a-81216c09636c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068944 Jan 24 09:19:31.723057 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 210/419] 10.222.0.113 () {58 vars in 1306 bytes} [Mon Jan 24 09:19:31 2022] GET /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:19:31.812283 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-dceba84c-626b-4f8e-b688-c649b07039e4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:31.813657 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-dceba84c-626b-4f8e-b688-c649b07039e4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:31.819275 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-6b874bcf-4ff7-4aad-9131-9bdafc3aef11 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:31.820389 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-6b874bcf-4ff7-4aad-9131-9bdafc3aef11 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:31.823478 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-dceba84c-626b-4f8e-b688-c649b07039e4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:31.824102 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-dceba84c-626b-4f8e-b688-c649b07039e4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:31.825380 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-dceba84c-626b-4f8e-b688-c649b07039e4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:31.825926 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-dceba84c-626b-4f8e-b688-c649b07039e4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:31.828184 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6b874bcf-4ff7-4aad-9131-9bdafc3aef11 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:31.828836 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6b874bcf-4ff7-4aad-9131-9bdafc3aef11 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:31.829619 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6b874bcf-4ff7-4aad-9131-9bdafc3aef11 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:31.830050 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6b874bcf-4ff7-4aad-9131-9bdafc3aef11 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:31.928564 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-dceba84c-626b-4f8e-b688-c649b07039e4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 28934 microversion: 2.20 time: 0.120876 Jan 24 09:19:31.929492 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 210/420] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:19:31 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 28934 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:19:31.954336 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-6b874bcf-4ff7-4aad-9131-9bdafc3aef11 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 29010 microversion: 2.1 time: 0.139823 Jan 24 09:19:31.956877 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 211/421] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:19:31 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 29010 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 09:19:32.671786 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-2c642186-6154-4db3-85d9-af054d5ea041 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:32.672483 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-2c642186-6154-4db3-85d9-af054d5ea041 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:32.679566 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-2c642186-6154-4db3-85d9-af054d5ea041 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:32.680009 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-2c642186-6154-4db3-85d9-af054d5ea041 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:32.680784 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-2c642186-6154-4db3-85d9-af054d5ea041 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:32.681212 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-2c642186-6154-4db3-85d9-af054d5ea041 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:32.736401 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-ad12912f-d08e-4f71-9069-a11ff811d990 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:32.737515 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-ad12912f-d08e-4f71-9069-a11ff811d990 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: f73fa07f-65bf-45c0-afb7-c5bfb0356243] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:32.744476 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ad12912f-d08e-4f71-9069-a11ff811d990 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:32.745002 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ad12912f-d08e-4f71-9069-a11ff811d990 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:32.745777 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ad12912f-d08e-4f71-9069-a11ff811d990 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:32.746233 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ad12912f-d08e-4f71-9069-a11ff811d990 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:32.775854 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-ad12912f-d08e-4f71-9069-a11ff811d990 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043719 Jan 24 09:19:32.776738 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 212/422] 10.222.0.113 () {58 vars in 1306 bytes} [Mon Jan 24 09:19:32 2022] GET /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 24 09:19:32.847142 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-2c642186-6154-4db3-85d9-af054d5ea041 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:32.855045 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-2c642186-6154-4db3-85d9-af054d5ea041 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1525 microversion: 2.1 time: 0.185191 Jan 24 09:19:32.855045 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 211/423] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:32 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1525 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:32.940993 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-593539ef-aade-4825-9114-7ca1218df1bc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:32.941802 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-593539ef-aade-4825-9114-7ca1218df1bc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:32.948596 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-593539ef-aade-4825-9114-7ca1218df1bc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:32.954016 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-09995b05-9e5a-49cd-858a-f7f35be18a7c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1614930118", "imageRef": "c527e37f-a381-465e-babe-11528029ed9b", "flavorRef": "452", "networks": [{"uuid": "595abfef-3114-4487-9adf-a62cd7425c5d"}]}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:32.960567 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-593539ef-aade-4825-9114-7ca1218df1bc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:32.961894 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-593539ef-aade-4825-9114-7ca1218df1bc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:32.962391 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-593539ef-aade-4825-9114-7ca1218df1bc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:33.016207 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.network.neutron [None req-09995b05-9e5a-49cd-858a-f7f35be18a7c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] validate_networks() for [('595abfef-3114-4487-9adf-a62cd7425c5d', None, None, None, None, None)] {{(pid=116863) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 09:19:33.625614 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.virt.hardware [None req-09995b05-9e5a-49cd-858a-f7f35be18a7c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Flavor limits 0:0:0 {{(pid=116863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 09:19:33.626037 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.virt.hardware [None req-09995b05-9e5a-49cd-858a-f7f35be18a7c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Image limits 0:0:0 {{(pid=116863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 09:19:33.626542 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.virt.hardware [None req-09995b05-9e5a-49cd-858a-f7f35be18a7c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Flavor pref 0:0:0 {{(pid=116863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 09:19:33.626951 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.virt.hardware [None req-09995b05-9e5a-49cd-858a-f7f35be18a7c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Image pref 0:0:0 {{(pid=116863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 09:19:33.627361 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.virt.hardware [None req-09995b05-9e5a-49cd-858a-f7f35be18a7c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 09:19:33.636062 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-09995b05-9e5a-49cd-858a-f7f35be18a7c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:33.636508 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-09995b05-9e5a-49cd-858a-f7f35be18a7c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:33.637318 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-09995b05-9e5a-49cd-858a-f7f35be18a7c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:33.637756 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-09995b05-9e5a-49cd-858a-f7f35be18a7c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:33.657756 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.quota [None req-09995b05-9e5a-49cd-858a-f7f35be18a7c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Getting quotas for project 9effc220352541ecba9f319db87235de. Resources: {'ram', 'cores', 'instances'} {{(pid=116863) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 09:19:33.663920 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.quota [None req-09995b05-9e5a-49cd-858a-f7f35be18a7c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Getting quotas for user 49d33f34357f4132b712dff54a6446f3 and project 9effc220352541ecba9f319db87235de. Resources: {'ram', 'cores', 'instances'} {{(pid=116863) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 09:19:33.677217 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-09995b05-9e5a-49cd-858a-f7f35be18a7c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Going to run 1 instances... {{(pid=116863) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 09:19:33.679561 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-09995b05-9e5a-49cd-858a-f7f35be18a7c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: d9db33c9-c45f-4643-ad2c-9da35f7ddd07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c527e37f-a381-465e-babe-11528029ed9b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 09:19:33.805287 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-09995b05-9e5a-49cd-858a-f7f35be18a7c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.854944 Jan 24 09:19:33.805955 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 212/424] 10.222.0.113 () {60 vars in 1151 bytes} [Mon Jan 24 09:19:32 2022] POST /compute/v2.1/servers => generated 382 bytes in 856 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jan 24 09:19:33.810465 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-1467b0df-544e-415e-909e-45ece75df551 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:33.811596 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-1467b0df-544e-415e-909e-45ece75df551 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:33.818114 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1467b0df-544e-415e-909e-45ece75df551 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:33.818580 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1467b0df-544e-415e-909e-45ece75df551 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:33.819372 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1467b0df-544e-415e-909e-45ece75df551 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:33.819812 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1467b0df-544e-415e-909e-45ece75df551 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:35.727637 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-593539ef-aade-4825-9114-7ca1218df1bc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 28934 microversion: 2.20 time: 2.790236 Jan 24 09:19:35.728185 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 213/425] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:19:32 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 28934 bytes in 2792 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 09:19:35.733931 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-6b89f1e0-f5bd-4c68-8ef0-59fe5db3c8bc tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:35.734661 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-6b89f1e0-f5bd-4c68-8ef0-59fe5db3c8bc tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: d9db33c9-c45f-4643-ad2c-9da35f7ddd07] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:35.742398 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6b89f1e0-f5bd-4c68-8ef0-59fe5db3c8bc tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:35.742854 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6b89f1e0-f5bd-4c68-8ef0-59fe5db3c8bc tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:35.743649 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6b89f1e0-f5bd-4c68-8ef0-59fe5db3c8bc tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:35.743826 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-1467b0df-544e-415e-909e-45ece75df551 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 29010 microversion: 2.1 time: 1.936216 Jan 24 09:19:35.744561 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6b89f1e0-f5bd-4c68-8ef0-59fe5db3c8bc tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:35.744785 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 213/426] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:19:33 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 29010 bytes in 1938 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:19:35.752212 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-58ea0ea5-f51a-466b-ae06-ed12823cb975 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:35.753035 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-58ea0ea5-f51a-466b-ae06-ed12823cb975 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:35.761619 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-58ea0ea5-f51a-466b-ae06-ed12823cb975 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:35.762263 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-58ea0ea5-f51a-466b-ae06-ed12823cb975 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:35.763166 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-58ea0ea5-f51a-466b-ae06-ed12823cb975 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:35.763665 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-58ea0ea5-f51a-466b-ae06-ed12823cb975 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:35.808941 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-6b89f1e0-f5bd-4c68-8ef0-59fe5db3c8bc tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:35.817465 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-6b89f1e0-f5bd-4c68-8ef0-59fe5db3c8bc tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07" status: 200 len: 1226 microversion: 2.1 time: 0.088027 Jan 24 09:19:35.818291 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 214/427] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:35 2022] GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:35.916557 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-58ea0ea5-f51a-466b-ae06-ed12823cb975 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:35.924473 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-58ea0ea5-f51a-466b-ae06-ed12823cb975 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1525 microversion: 2.1 time: 0.178286 Jan 24 09:19:35.925038 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 214/428] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:35 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1525 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:36.739124 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-d2742b26-37bb-46f9-8863-fa429ebf205c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:36.740094 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-d2742b26-37bb-46f9-8863-fa429ebf205c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:36.746461 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d2742b26-37bb-46f9-8863-fa429ebf205c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:36.746833 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d2742b26-37bb-46f9-8863-fa429ebf205c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:36.749663 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d2742b26-37bb-46f9-8863-fa429ebf205c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:36.749663 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d2742b26-37bb-46f9-8863-fa429ebf205c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:36.762623 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-3e6869ba-fbd1-4112-8afb-3d521218931c tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:36.764967 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-3e6869ba-fbd1-4112-8afb-3d521218931c tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:36.784227 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3e6869ba-fbd1-4112-8afb-3d521218931c tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:36.784715 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3e6869ba-fbd1-4112-8afb-3d521218931c tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:36.785513 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3e6869ba-fbd1-4112-8afb-3d521218931c tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:36.785949 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3e6869ba-fbd1-4112-8afb-3d521218931c tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:36.832841 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-d2742b26-37bb-46f9-8863-fa429ebf205c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 28934 microversion: 2.20 time: 0.097184 Jan 24 09:19:36.833427 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 215/429] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:19:36 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 28934 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:19:36.839121 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-57529528-de95-4825-a20d-fcb9bf3ddd12 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:36.839818 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-57529528-de95-4825-a20d-fcb9bf3ddd12 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: d9db33c9-c45f-4643-ad2c-9da35f7ddd07] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:36.847152 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-57529528-de95-4825-a20d-fcb9bf3ddd12 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:36.847586 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-57529528-de95-4825-a20d-fcb9bf3ddd12 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:36.849081 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-57529528-de95-4825-a20d-fcb9bf3ddd12 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:36.849081 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-57529528-de95-4825-a20d-fcb9bf3ddd12 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:36.859264 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-3e6869ba-fbd1-4112-8afb-3d521218931c tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 29010 microversion: 2.1 time: 0.102970 Jan 24 09:19:36.867171 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 215/430] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:19:36 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 29010 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 09:19:36.917267 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-57529528-de95-4825-a20d-fcb9bf3ddd12 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:36.927113 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-57529528-de95-4825-a20d-fcb9bf3ddd12 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07" status: 200 len: 1274 microversion: 2.1 time: 0.092184 Jan 24 09:19:36.927696 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 216/431] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:36 2022] GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07 => generated 1274 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:36.946181 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-af7f1584-b673-49ad-a52b-1a873e34ca7c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:36.947438 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-af7f1584-b673-49ad-a52b-1a873e34ca7c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:36.960395 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-af7f1584-b673-49ad-a52b-1a873e34ca7c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:36.961177 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-af7f1584-b673-49ad-a52b-1a873e34ca7c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:36.962680 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-af7f1584-b673-49ad-a52b-1a873e34ca7c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:36.963496 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-af7f1584-b673-49ad-a52b-1a873e34ca7c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:37.213084 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-af7f1584-b673-49ad-a52b-1a873e34ca7c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:37.221851 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-af7f1584-b673-49ad-a52b-1a873e34ca7c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1525 microversion: 2.1 time: 0.283443 Jan 24 09:19:37.222501 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 216/432] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:36 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1525 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:37.845531 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-a37222d1-3b56-4462-bc1b-6542fe540961 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:37.846750 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-a37222d1-3b56-4462-bc1b-6542fe540961 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:37.853830 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a37222d1-3b56-4462-bc1b-6542fe540961 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:37.854468 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a37222d1-3b56-4462-bc1b-6542fe540961 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:37.855381 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a37222d1-3b56-4462-bc1b-6542fe540961 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:37.855927 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a37222d1-3b56-4462-bc1b-6542fe540961 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:37.880445 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-ba2c6621-d102-48b3-86c9-4360fed93b20 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:37.882282 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-ba2c6621-d102-48b3-86c9-4360fed93b20 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:37.898824 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ba2c6621-d102-48b3-86c9-4360fed93b20 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:37.905283 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ba2c6621-d102-48b3-86c9-4360fed93b20 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:37.905283 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ba2c6621-d102-48b3-86c9-4360fed93b20 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:37.905283 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ba2c6621-d102-48b3-86c9-4360fed93b20 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:37.950751 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-a37222d1-3b56-4462-bc1b-6542fe540961 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 28934 microversion: 2.20 time: 0.109763 Jan 24 09:19:37.951986 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 217/433] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:19:37 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 28934 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:19:37.957267 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-157a0219-722a-4ee4-a834-14363f14d57a tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:37.957958 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-157a0219-722a-4ee4-a834-14363f14d57a tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: d9db33c9-c45f-4643-ad2c-9da35f7ddd07] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:37.972550 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-157a0219-722a-4ee4-a834-14363f14d57a tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:37.973237 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-157a0219-722a-4ee4-a834-14363f14d57a tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:37.974085 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-157a0219-722a-4ee4-a834-14363f14d57a tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:37.974644 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-157a0219-722a-4ee4-a834-14363f14d57a tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:38.027968 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-ba2c6621-d102-48b3-86c9-4360fed93b20 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 29010 microversion: 2.1 time: 0.155851 Jan 24 09:19:38.031081 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 217/434] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:19:37 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 29010 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:19:38.177797 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-157a0219-722a-4ee4-a834-14363f14d57a tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:38.194211 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-157a0219-722a-4ee4-a834-14363f14d57a tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07" status: 200 len: 1322 microversion: 2.1 time: 0.239788 Jan 24 09:19:38.195585 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 218/435] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:37 2022] GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07 => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:38.242419 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-65b61bbe-0687-4f71-89c8-3c1563574d70 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:38.244234 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-65b61bbe-0687-4f71-89c8-3c1563574d70 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:38.258160 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-65b61bbe-0687-4f71-89c8-3c1563574d70 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:38.259065 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-65b61bbe-0687-4f71-89c8-3c1563574d70 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:38.260669 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-65b61bbe-0687-4f71-89c8-3c1563574d70 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:38.261439 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-65b61bbe-0687-4f71-89c8-3c1563574d70 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:38.627684 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-65b61bbe-0687-4f71-89c8-3c1563574d70 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:38.635844 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-65b61bbe-0687-4f71-89c8-3c1563574d70 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1525 microversion: 2.1 time: 0.399673 Jan 24 09:19:38.646213 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 218/436] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:38 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1525 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:38.965682 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-3f57408a-66dc-485f-a86b-c2c4874ee163 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:38.967893 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-3f57408a-66dc-485f-a86b-c2c4874ee163 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:38.974843 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3f57408a-66dc-485f-a86b-c2c4874ee163 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:38.983268 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3f57408a-66dc-485f-a86b-c2c4874ee163 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:38.983268 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3f57408a-66dc-485f-a86b-c2c4874ee163 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:38.983268 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3f57408a-66dc-485f-a86b-c2c4874ee163 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:39.043756 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-dcdd8955-66b6-42da-8f88-357849afebb1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:39.043756 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-dcdd8955-66b6-42da-8f88-357849afebb1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:39.052061 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-dcdd8955-66b6-42da-8f88-357849afebb1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:39.052768 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-dcdd8955-66b6-42da-8f88-357849afebb1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:39.053658 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-dcdd8955-66b6-42da-8f88-357849afebb1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:39.054214 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-dcdd8955-66b6-42da-8f88-357849afebb1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:39.093428 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-3f57408a-66dc-485f-a86b-c2c4874ee163 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 28981 microversion: 2.20 time: 0.132011 Jan 24 09:19:39.094791 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 219/437] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:19:38 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 28981 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:19:39.192568 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-dcdd8955-66b6-42da-8f88-357849afebb1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 29128 microversion: 2.1 time: 0.154162 Jan 24 09:19:39.196201 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 219/438] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:19:39 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 29128 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 09:19:39.219993 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-2904ff52-cbd9-49b3-9e00-6a9f250d828d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:39.221235 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-2904ff52-cbd9-49b3-9e00-6a9f250d828d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: d9db33c9-c45f-4643-ad2c-9da35f7ddd07] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:39.237190 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2904ff52-cbd9-49b3-9e00-6a9f250d828d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:39.237993 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2904ff52-cbd9-49b3-9e00-6a9f250d828d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:39.239455 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2904ff52-cbd9-49b3-9e00-6a9f250d828d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:39.240424 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2904ff52-cbd9-49b3-9e00-6a9f250d828d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:39.323223 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [req-d5ad018b-00bd-4508-8b67-ad50b988c353 req-7875f950-651a-4f09-a736-7e44688ba1ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9db33c9-c45f-4643-ad2c-9da35f7ddd07", "tag": "8f1acf57-8e99-4966-b91e-ff0b6193520a"}]} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:39.332776 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:19:39.332776 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: warnings.warn(msg) Jan 24 09:19:39.365819 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-d5ad018b-00bd-4508-8b67-ad50b988c353 req-7875f950-651a-4f09-a736-7e44688ba1ad service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:39.367158 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-d5ad018b-00bd-4508-8b67-ad50b988c353 req-7875f950-651a-4f09-a736-7e44688ba1ad service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:39.386932 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.compute.server_external_events [req-d5ad018b-00bd-4508-8b67-ad50b988c353 req-7875f950-651a-4f09-a736-7e44688ba1ad service nova] Creating event network-changed:8f1acf57-8e99-4966-b91e-ff0b6193520a for instance d9db33c9-c45f-4643-ad2c-9da35f7ddd07 on hv-cinder-80403 Jan 24 09:19:39.392405 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [req-d5ad018b-00bd-4508-8b67-ad50b988c353 req-7875f950-651a-4f09-a736-7e44688ba1ad service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082866 Jan 24 09:19:39.393458 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 220/439] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:19:39.491789 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-2904ff52-cbd9-49b3-9e00-6a9f250d828d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:39.507627 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-2904ff52-cbd9-49b3-9e00-6a9f250d828d tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07" status: 200 len: 1322 microversion: 2.1 time: 0.296227 Jan 24 09:19:39.508642 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 220/440] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:39 2022] GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07 => generated 1322 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:39.653756 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-7fb4ad57-1c9c-4b9b-a06e-30e9a0e16460 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:39.654787 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-7fb4ad57-1c9c-4b9b-a06e-30e9a0e16460 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:39.663613 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7fb4ad57-1c9c-4b9b-a06e-30e9a0e16460 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:39.664290 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7fb4ad57-1c9c-4b9b-a06e-30e9a0e16460 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:39.665253 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7fb4ad57-1c9c-4b9b-a06e-30e9a0e16460 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:39.666175 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7fb4ad57-1c9c-4b9b-a06e-30e9a0e16460 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:39.986643 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-7fb4ad57-1c9c-4b9b-a06e-30e9a0e16460 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:39.995883 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-7fb4ad57-1c9c-4b9b-a06e-30e9a0e16460 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1525 microversion: 2.1 time: 0.346838 Jan 24 09:19:39.997035 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 221/441] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:39 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1525 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:40.110120 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-b006c778-6513-4606-801e-ea8e27b70e9e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:40.111829 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-b006c778-6513-4606-801e-ea8e27b70e9e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:40.118994 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b006c778-6513-4606-801e-ea8e27b70e9e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:40.120130 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b006c778-6513-4606-801e-ea8e27b70e9e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:40.121508 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b006c778-6513-4606-801e-ea8e27b70e9e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:40.122238 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b006c778-6513-4606-801e-ea8e27b70e9e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:40.206231 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-e6759a3a-bac3-45ba-b7b7-350f831f08fd tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:40.207172 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-e6759a3a-bac3-45ba-b7b7-350f831f08fd tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:40.224225 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e6759a3a-bac3-45ba-b7b7-350f831f08fd tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:40.224744 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e6759a3a-bac3-45ba-b7b7-350f831f08fd tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:40.225538 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e6759a3a-bac3-45ba-b7b7-350f831f08fd tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:40.225962 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e6759a3a-bac3-45ba-b7b7-350f831f08fd tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:40.281322 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-b006c778-6513-4606-801e-ea8e27b70e9e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 29701 microversion: 2.20 time: 0.178193 Jan 24 09:19:40.282153 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 221/442] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:19:40 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 29701 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:19:40.398425 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-e6759a3a-bac3-45ba-b7b7-350f831f08fd tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 29811 microversion: 2.1 time: 0.194724 Jan 24 09:19:40.399093 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 222/443] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:19:40 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 29811 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:19:40.530734 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-8cb23cd6-86df-4ab7-ae02-e05d3ca7d539 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:40.531510 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-8cb23cd6-86df-4ab7-ae02-e05d3ca7d539 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: d9db33c9-c45f-4643-ad2c-9da35f7ddd07] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:40.539459 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-8cb23cd6-86df-4ab7-ae02-e05d3ca7d539 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:40.541776 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-8cb23cd6-86df-4ab7-ae02-e05d3ca7d539 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:40.541776 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-8cb23cd6-86df-4ab7-ae02-e05d3ca7d539 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:40.541776 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-8cb23cd6-86df-4ab7-ae02-e05d3ca7d539 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:40.820955 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-8cb23cd6-86df-4ab7-ae02-e05d3ca7d539 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:40.830630 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-8cb23cd6-86df-4ab7-ae02-e05d3ca7d539 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07" status: 200 len: 1322 microversion: 2.1 time: 0.305057 Jan 24 09:19:40.831490 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 222/444] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:40 2022] GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07 => generated 1322 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:41.017496 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-3edc4dc4-d33d-495d-a4f7-a92932a2dd65 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:41.018231 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-3edc4dc4-d33d-495d-a4f7-a92932a2dd65 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:41.026011 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3edc4dc4-d33d-495d-a4f7-a92932a2dd65 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:41.028802 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3edc4dc4-d33d-495d-a4f7-a92932a2dd65 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:41.028802 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3edc4dc4-d33d-495d-a4f7-a92932a2dd65 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:41.028802 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3edc4dc4-d33d-495d-a4f7-a92932a2dd65 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:41.224114 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-3edc4dc4-d33d-495d-a4f7-a92932a2dd65 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:41.235401 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-3edc4dc4-d33d-495d-a4f7-a92932a2dd65 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1525 microversion: 2.1 time: 0.224343 Jan 24 09:19:41.236637 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 223/445] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:41 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1525 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:41.294177 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-4f79dcde-7952-4af2-ab83-0233bb872eb7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:41.297160 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-4f79dcde-7952-4af2-ab83-0233bb872eb7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:41.307711 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4f79dcde-7952-4af2-ab83-0233bb872eb7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:41.308645 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4f79dcde-7952-4af2-ab83-0233bb872eb7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:41.309981 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4f79dcde-7952-4af2-ab83-0233bb872eb7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:41.310665 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4f79dcde-7952-4af2-ab83-0233bb872eb7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:41.410694 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-078fdd46-c4b4-4071-80c6-457f31539632 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:41.412743 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-078fdd46-c4b4-4071-80c6-457f31539632 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:41.423181 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-078fdd46-c4b4-4071-80c6-457f31539632 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:41.424422 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-078fdd46-c4b4-4071-80c6-457f31539632 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:41.425118 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-078fdd46-c4b4-4071-80c6-457f31539632 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:41.425718 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-078fdd46-c4b4-4071-80c6-457f31539632 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:41.427363 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-4f79dcde-7952-4af2-ab83-0233bb872eb7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 30480 microversion: 2.20 time: 0.136280 Jan 24 09:19:41.428279 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 223/446] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:19:41 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 30480 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 09:19:41.534588 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-078fdd46-c4b4-4071-80c6-457f31539632 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 30550 microversion: 2.1 time: 0.126898 Jan 24 09:19:41.535466 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 224/447] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:19:41 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 30550 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 09:19:41.850629 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-ada060b5-c21e-4767-a2f8-d5e267a1b092 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:41.851658 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-ada060b5-c21e-4767-a2f8-d5e267a1b092 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: d9db33c9-c45f-4643-ad2c-9da35f7ddd07] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:41.874130 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ada060b5-c21e-4767-a2f8-d5e267a1b092 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:41.876897 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ada060b5-c21e-4767-a2f8-d5e267a1b092 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:41.876897 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ada060b5-c21e-4767-a2f8-d5e267a1b092 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:41.882212 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ada060b5-c21e-4767-a2f8-d5e267a1b092 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:42.061355 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-ada060b5-c21e-4767-a2f8-d5e267a1b092 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:42.075625 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-ada060b5-c21e-4767-a2f8-d5e267a1b092 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07" status: 200 len: 1322 microversion: 2.1 time: 0.231310 Jan 24 09:19:42.082281 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 224/448] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:41 2022] GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07 => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:42.253801 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-514b2c2c-e20b-4589-8f77-4c8d221d4e74 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:42.255102 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-514b2c2c-e20b-4589-8f77-4c8d221d4e74 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:42.261935 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-514b2c2c-e20b-4589-8f77-4c8d221d4e74 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:42.262896 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-514b2c2c-e20b-4589-8f77-4c8d221d4e74 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:42.264272 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-514b2c2c-e20b-4589-8f77-4c8d221d4e74 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:42.264906 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-514b2c2c-e20b-4589-8f77-4c8d221d4e74 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:42.441851 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-ede870c2-90bb-4866-aadd-2c5b34070ec0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:42.443557 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-ede870c2-90bb-4866-aadd-2c5b34070ec0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:42.453244 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ede870c2-90bb-4866-aadd-2c5b34070ec0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:42.454086 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ede870c2-90bb-4866-aadd-2c5b34070ec0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:42.455868 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ede870c2-90bb-4866-aadd-2c5b34070ec0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:42.456666 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ede870c2-90bb-4866-aadd-2c5b34070ec0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:42.535164 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-514b2c2c-e20b-4589-8f77-4c8d221d4e74 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:42.548058 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-514b2c2c-e20b-4589-8f77-4c8d221d4e74 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1525 microversion: 2.1 time: 0.298666 Jan 24 09:19:42.562073 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 225/449] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:42 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1525 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:19:42.568980 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-b19f20cc-14ba-468d-8c86-d0e3382cb570 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:42.569954 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-b19f20cc-14ba-468d-8c86-d0e3382cb570 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:42.582026 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b19f20cc-14ba-468d-8c86-d0e3382cb570 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:42.582620 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b19f20cc-14ba-468d-8c86-d0e3382cb570 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:42.583470 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b19f20cc-14ba-468d-8c86-d0e3382cb570 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:42.583833 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b19f20cc-14ba-468d-8c86-d0e3382cb570 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:43.556789 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-ede870c2-90bb-4866-aadd-2c5b34070ec0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 31479 microversion: 2.20 time: 1.120741 Jan 24 09:19:43.557545 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 225/450] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:19:42 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 31479 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:19:43.564570 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-fe1ba7d2-5133-43c0-9e95-b3ed127e9c01 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:43.566450 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-fe1ba7d2-5133-43c0-9e95-b3ed127e9c01 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: d9db33c9-c45f-4643-ad2c-9da35f7ddd07] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:43.578285 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fe1ba7d2-5133-43c0-9e95-b3ed127e9c01 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:43.578988 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fe1ba7d2-5133-43c0-9e95-b3ed127e9c01 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:43.580263 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fe1ba7d2-5133-43c0-9e95-b3ed127e9c01 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:43.581268 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fe1ba7d2-5133-43c0-9e95-b3ed127e9c01 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:43.793311 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-fe1ba7d2-5133-43c0-9e95-b3ed127e9c01 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:43.804539 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-fe1ba7d2-5133-43c0-9e95-b3ed127e9c01 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07" status: 200 len: 1322 microversion: 2.1 time: 0.245146 Jan 24 09:19:43.805749 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 226/451] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:43 2022] GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07 => generated 1322 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:43.811303 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-d694f81f-8913-4ab6-bd95-50a650480d16 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:43.812165 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-d694f81f-8913-4ab6-bd95-50a650480d16 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:43.819222 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d694f81f-8913-4ab6-bd95-50a650480d16 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:43.819916 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d694f81f-8913-4ab6-bd95-50a650480d16 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:43.820913 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d694f81f-8913-4ab6-bd95-50a650480d16 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:43.821517 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d694f81f-8913-4ab6-bd95-50a650480d16 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:44.018201 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-d694f81f-8913-4ab6-bd95-50a650480d16 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:44.042676 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-d694f81f-8913-4ab6-bd95-50a650480d16 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1525 microversion: 2.1 time: 0.223881 Jan 24 09:19:44.043333 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 227/452] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:43 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1525 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:44.583636 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-439519de-7cc3-4fc0-85d2-bb7b978d4c69 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:44.593576 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-439519de-7cc3-4fc0-85d2-bb7b978d4c69 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:44.605706 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-439519de-7cc3-4fc0-85d2-bb7b978d4c69 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:44.609228 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-439519de-7cc3-4fc0-85d2-bb7b978d4c69 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:44.611566 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-439519de-7cc3-4fc0-85d2-bb7b978d4c69 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:44.612637 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-439519de-7cc3-4fc0-85d2-bb7b978d4c69 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:45.543822 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-b19f20cc-14ba-468d-8c86-d0e3382cb570 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 33205 microversion: 2.1 time: 2.989628 Jan 24 09:19:45.544577 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 226/453] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:19:42 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 33205 bytes in 2991 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:19:45.552135 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-e5247a1a-57dc-4046-b3bd-7784f044cb3b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:45.552846 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-e5247a1a-57dc-4046-b3bd-7784f044cb3b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: d9db33c9-c45f-4643-ad2c-9da35f7ddd07] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:45.565802 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e5247a1a-57dc-4046-b3bd-7784f044cb3b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:45.565802 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e5247a1a-57dc-4046-b3bd-7784f044cb3b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:45.565802 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e5247a1a-57dc-4046-b3bd-7784f044cb3b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:45.565802 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e5247a1a-57dc-4046-b3bd-7784f044cb3b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:45.635944 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-439519de-7cc3-4fc0-85d2-bb7b978d4c69 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 33319 microversion: 2.20 time: 1.064897 Jan 24 09:19:45.641211 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 228/454] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:19:44 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 33319 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:19:45.664899 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-f5144fad-d417-4cc2-aeeb-7b8e188e43bd tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:45.665952 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-f5144fad-d417-4cc2-aeeb-7b8e188e43bd tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:45.677448 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f5144fad-d417-4cc2-aeeb-7b8e188e43bd tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:45.677907 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f5144fad-d417-4cc2-aeeb-7b8e188e43bd tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:45.678845 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f5144fad-d417-4cc2-aeeb-7b8e188e43bd tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:45.679184 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f5144fad-d417-4cc2-aeeb-7b8e188e43bd tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:45.795277 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-e5247a1a-57dc-4046-b3bd-7784f044cb3b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:45.807710 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-e5247a1a-57dc-4046-b3bd-7784f044cb3b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07" status: 200 len: 1322 microversion: 2.1 time: 0.258659 Jan 24 09:19:45.818256 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 227/455] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:45 2022] GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07 => generated 1322 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:45.978818 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-f5144fad-d417-4cc2-aeeb-7b8e188e43bd tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:45.987926 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-f5144fad-d417-4cc2-aeeb-7b8e188e43bd tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1525 microversion: 2.1 time: 0.345021 Jan 24 09:19:45.988763 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 229/456] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:45 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1525 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:46.557218 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-e0387763-3e4f-4f7d-876f-abeb42c371f8 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:46.558723 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-e0387763-3e4f-4f7d-876f-abeb42c371f8 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:46.566646 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e0387763-3e4f-4f7d-876f-abeb42c371f8 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:46.567101 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e0387763-3e4f-4f7d-876f-abeb42c371f8 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:46.568764 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e0387763-3e4f-4f7d-876f-abeb42c371f8 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:46.568764 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e0387763-3e4f-4f7d-876f-abeb42c371f8 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:46.664304 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-c2f7f6c0-8317-4873-961d-e0db566ddbf8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:46.665418 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-c2f7f6c0-8317-4873-961d-e0db566ddbf8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:46.674915 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c2f7f6c0-8317-4873-961d-e0db566ddbf8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:46.675702 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c2f7f6c0-8317-4873-961d-e0db566ddbf8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:46.676993 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c2f7f6c0-8317-4873-961d-e0db566ddbf8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:46.677650 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c2f7f6c0-8317-4873-961d-e0db566ddbf8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:46.688378 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-e0387763-3e4f-4f7d-876f-abeb42c371f8 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 33530 microversion: 2.1 time: 0.134552 Jan 24 09:19:46.689183 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 228/457] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:19:46 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 33530 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 09:19:46.809429 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-c2f7f6c0-8317-4873-961d-e0db566ddbf8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 33634 microversion: 2.20 time: 0.153170 Jan 24 09:19:46.811583 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 230/458] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:19:46 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 33634 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:19:46.834069 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-215fd13f-7b5e-429b-9f2e-272f2f587477 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:46.834941 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-215fd13f-7b5e-429b-9f2e-272f2f587477 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: d9db33c9-c45f-4643-ad2c-9da35f7ddd07] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:46.845035 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-215fd13f-7b5e-429b-9f2e-272f2f587477 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:46.845565 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-215fd13f-7b5e-429b-9f2e-272f2f587477 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:46.847044 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-215fd13f-7b5e-429b-9f2e-272f2f587477 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:46.847490 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-215fd13f-7b5e-429b-9f2e-272f2f587477 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:47.010519 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-ff9d3e17-90ae-4892-a794-e49f08a173c4 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:47.011517 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-ff9d3e17-90ae-4892-a794-e49f08a173c4 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:47.019517 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ff9d3e17-90ae-4892-a794-e49f08a173c4 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:47.019989 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ff9d3e17-90ae-4892-a794-e49f08a173c4 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:47.021077 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ff9d3e17-90ae-4892-a794-e49f08a173c4 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:47.021675 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ff9d3e17-90ae-4892-a794-e49f08a173c4 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:47.047630 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-215fd13f-7b5e-429b-9f2e-272f2f587477 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:47.063273 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-215fd13f-7b5e-429b-9f2e-272f2f587477 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07" status: 200 len: 1322 microversion: 2.1 time: 0.235191 Jan 24 09:19:47.064391 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 229/459] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:46 2022] GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07 => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:19:47.208745 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-ff9d3e17-90ae-4892-a794-e49f08a173c4 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:47.217791 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-ff9d3e17-90ae-4892-a794-e49f08a173c4 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1525 microversion: 2.1 time: 0.211597 Jan 24 09:19:47.218568 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 231/460] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:47 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1525 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:19:47.707201 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-a75b9698-c4cb-4915-bbe1-a37cb13966f1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:47.709899 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-a75b9698-c4cb-4915-bbe1-a37cb13966f1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:47.728531 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a75b9698-c4cb-4915-bbe1-a37cb13966f1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:47.728810 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a75b9698-c4cb-4915-bbe1-a37cb13966f1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:47.729617 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a75b9698-c4cb-4915-bbe1-a37cb13966f1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:47.730057 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a75b9698-c4cb-4915-bbe1-a37cb13966f1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:47.832479 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-f1fb1981-7664-4341-9194-8bbfcb3c4272 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:47.832479 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-f1fb1981-7664-4341-9194-8bbfcb3c4272 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:47.832479 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f1fb1981-7664-4341-9194-8bbfcb3c4272 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:47.832479 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f1fb1981-7664-4341-9194-8bbfcb3c4272 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:47.833183 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f1fb1981-7664-4341-9194-8bbfcb3c4272 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:47.833271 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f1fb1981-7664-4341-9194-8bbfcb3c4272 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:47.870745 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-a75b9698-c4cb-4915-bbe1-a37cb13966f1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 33935 microversion: 2.1 time: 0.169887 Jan 24 09:19:47.873632 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 230/461] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:19:47 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 33935 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:19:47.942856 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-f1fb1981-7664-4341-9194-8bbfcb3c4272 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 34028 microversion: 2.20 time: 0.124247 Jan 24 09:19:47.948712 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 232/462] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:19:47 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 34028 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 09:19:48.082075 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-db88602a-ede1-44d8-92de-c7180d1f9463 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:48.087164 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-db88602a-ede1-44d8-92de-c7180d1f9463 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: d9db33c9-c45f-4643-ad2c-9da35f7ddd07] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:48.090631 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-db88602a-ede1-44d8-92de-c7180d1f9463 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:48.091055 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-db88602a-ede1-44d8-92de-c7180d1f9463 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:48.092470 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-db88602a-ede1-44d8-92de-c7180d1f9463 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:48.092937 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-db88602a-ede1-44d8-92de-c7180d1f9463 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:48.238863 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-f9f2c5b6-f5b8-4719-b153-9e5b9775300d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:48.240341 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-f9f2c5b6-f5b8-4719-b153-9e5b9775300d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:48.252578 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f9f2c5b6-f5b8-4719-b153-9e5b9775300d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:48.253225 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f9f2c5b6-f5b8-4719-b153-9e5b9775300d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:48.254284 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f9f2c5b6-f5b8-4719-b153-9e5b9775300d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:48.255077 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f9f2c5b6-f5b8-4719-b153-9e5b9775300d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:48.308954 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-db88602a-ede1-44d8-92de-c7180d1f9463 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:48.332717 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-db88602a-ede1-44d8-92de-c7180d1f9463 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07" status: 200 len: 1322 microversion: 2.1 time: 0.255221 Jan 24 09:19:48.333205 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 231/463] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:48 2022] GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07 => generated 1322 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:48.382217 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [req-6e5ff234-7026-4af1-8688-2ea29ae59253 req-f788f934-28cd-435f-99e6-af8c7571305f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9db33c9-c45f-4643-ad2c-9da35f7ddd07", "name": "network-vif-plugged", "status": "completed", "tag": "8f1acf57-8e99-4966-b91e-ff0b6193520a"}]} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:48.385603 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:19:48.385603 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: warnings.warn(msg) Jan 24 09:19:48.402499 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-6e5ff234-7026-4af1-8688-2ea29ae59253 req-f788f934-28cd-435f-99e6-af8c7571305f service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:48.403591 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-6e5ff234-7026-4af1-8688-2ea29ae59253 req-f788f934-28cd-435f-99e6-af8c7571305f service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:48.438535 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.compute.server_external_events [req-6e5ff234-7026-4af1-8688-2ea29ae59253 req-f788f934-28cd-435f-99e6-af8c7571305f service nova] Creating event network-vif-plugged:8f1acf57-8e99-4966-b91e-ff0b6193520a for instance d9db33c9-c45f-4643-ad2c-9da35f7ddd07 on hv-cinder-80403 Jan 24 09:19:48.446075 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [req-6e5ff234-7026-4af1-8688-2ea29ae59253 req-f788f934-28cd-435f-99e6-af8c7571305f service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070995 Jan 24 09:19:48.447319 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 232/464] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:19:48.528519 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-f9f2c5b6-f5b8-4719-b153-9e5b9775300d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:48.547059 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-f9f2c5b6-f5b8-4719-b153-9e5b9775300d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1525 microversion: 2.1 time: 0.314364 Jan 24 09:19:48.549247 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 233/465] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:48 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1525 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:48.886264 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-47ccbe44-b3a6-4912-b700-535b11fe41b0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:48.887330 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-47ccbe44-b3a6-4912-b700-535b11fe41b0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:48.900142 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-47ccbe44-b3a6-4912-b700-535b11fe41b0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:48.900880 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-47ccbe44-b3a6-4912-b700-535b11fe41b0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:48.901820 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-47ccbe44-b3a6-4912-b700-535b11fe41b0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:48.904081 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-47ccbe44-b3a6-4912-b700-535b11fe41b0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:48.955276 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-aa272fb8-5b70-4af9-9a26-d9f320e4f64f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:48.956395 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-aa272fb8-5b70-4af9-9a26-d9f320e4f64f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:48.963123 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-aa272fb8-5b70-4af9-9a26-d9f320e4f64f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:48.963576 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-aa272fb8-5b70-4af9-9a26-d9f320e4f64f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:48.964370 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-aa272fb8-5b70-4af9-9a26-d9f320e4f64f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:48.964810 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-aa272fb8-5b70-4af9-9a26-d9f320e4f64f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:49.268427 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-47ccbe44-b3a6-4912-b700-535b11fe41b0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 34614 microversion: 2.1 time: 0.387409 Jan 24 09:19:49.284142 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 233/466] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:19:48 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 34614 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:19:49.317402 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-aa272fb8-5b70-4af9-9a26-d9f320e4f64f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 34576 microversion: 2.20 time: 0.365441 Jan 24 09:19:49.319311 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 234/467] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:19:48 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 34576 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 09:19:49.351932 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-feaf4877-0001-4175-9262-95c3a2f8f661 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:49.352766 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-feaf4877-0001-4175-9262-95c3a2f8f661 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: d9db33c9-c45f-4643-ad2c-9da35f7ddd07] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:49.365265 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-feaf4877-0001-4175-9262-95c3a2f8f661 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:49.366523 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-feaf4877-0001-4175-9262-95c3a2f8f661 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:49.367560 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-feaf4877-0001-4175-9262-95c3a2f8f661 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:49.368070 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-feaf4877-0001-4175-9262-95c3a2f8f661 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:49.517460 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-feaf4877-0001-4175-9262-95c3a2f8f661 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:49.524941 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-feaf4877-0001-4175-9262-95c3a2f8f661 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07" status: 200 len: 1322 microversion: 2.1 time: 0.177044 Jan 24 09:19:49.525591 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 234/468] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:49 2022] GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:49.566421 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-4a9727df-0086-4f6c-9441-237b997ac2aa tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:49.567124 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-4a9727df-0086-4f6c-9441-237b997ac2aa tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:49.574035 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4a9727df-0086-4f6c-9441-237b997ac2aa tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:49.574843 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4a9727df-0086-4f6c-9441-237b997ac2aa tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:49.575299 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4a9727df-0086-4f6c-9441-237b997ac2aa tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:49.575856 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4a9727df-0086-4f6c-9441-237b997ac2aa tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:49.759427 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-4a9727df-0086-4f6c-9441-237b997ac2aa tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:49.768725 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-4a9727df-0086-4f6c-9441-237b997ac2aa tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1525 microversion: 2.1 time: 0.206176 Jan 24 09:19:49.769389 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 235/469] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:49 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1525 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:50.294517 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-60a4f888-70fd-4b25-b0d5-e20d79e745d6 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:50.297537 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-60a4f888-70fd-4b25-b0d5-e20d79e745d6 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:50.310494 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-60a4f888-70fd-4b25-b0d5-e20d79e745d6 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:50.311668 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-60a4f888-70fd-4b25-b0d5-e20d79e745d6 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:50.313851 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-60a4f888-70fd-4b25-b0d5-e20d79e745d6 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:50.314886 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-60a4f888-70fd-4b25-b0d5-e20d79e745d6 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:50.332181 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-a2af443a-9ebc-4b70-b4ea-7cbba3c836c8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:50.333539 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-a2af443a-9ebc-4b70-b4ea-7cbba3c836c8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:50.350870 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a2af443a-9ebc-4b70-b4ea-7cbba3c836c8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:50.351382 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a2af443a-9ebc-4b70-b4ea-7cbba3c836c8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:50.352328 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a2af443a-9ebc-4b70-b4ea-7cbba3c836c8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:50.352923 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a2af443a-9ebc-4b70-b4ea-7cbba3c836c8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:50.738608 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-60a4f888-70fd-4b25-b0d5-e20d79e745d6 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 35566 microversion: 2.1 time: 0.454409 Jan 24 09:19:50.744225 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 235/470] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:19:50 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 35566 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:19:50.759646 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-18c55d6e-9a73-4fae-83c6-ab7bf115b05a tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:50.760610 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-a2af443a-9ebc-4b70-b4ea-7cbba3c836c8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 35189 microversion: 2.20 time: 0.434540 Jan 24 09:19:50.760777 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-18c55d6e-9a73-4fae-83c6-ab7bf115b05a tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: d9db33c9-c45f-4643-ad2c-9da35f7ddd07] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:50.761268 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 236/471] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:19:50 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 35189 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:19:50.785070 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-18c55d6e-9a73-4fae-83c6-ab7bf115b05a tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:50.785998 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-18c55d6e-9a73-4fae-83c6-ab7bf115b05a tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:50.787503 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-18c55d6e-9a73-4fae-83c6-ab7bf115b05a tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:50.788219 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-18c55d6e-9a73-4fae-83c6-ab7bf115b05a tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:50.789158 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-d2c1bee2-e7a8-4457-acea-ac4e9d788354 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:50.790066 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-d2c1bee2-e7a8-4457-acea-ac4e9d788354 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:50.802323 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d2c1bee2-e7a8-4457-acea-ac4e9d788354 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:50.802590 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d2c1bee2-e7a8-4457-acea-ac4e9d788354 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:50.804328 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d2c1bee2-e7a8-4457-acea-ac4e9d788354 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:50.804936 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d2c1bee2-e7a8-4457-acea-ac4e9d788354 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:51.015995 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-d2c1bee2-e7a8-4457-acea-ac4e9d788354 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:51.024483 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-d2c1bee2-e7a8-4457-acea-ac4e9d788354 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1525 microversion: 2.1 time: 0.242098 Jan 24 09:19:51.026188 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 237/472] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:50 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1525 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:19:51.047208 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-18c55d6e-9a73-4fae-83c6-ab7bf115b05a tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:51.061849 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-18c55d6e-9a73-4fae-83c6-ab7bf115b05a tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07" status: 200 len: 1322 microversion: 2.1 time: 0.312001 Jan 24 09:19:51.063068 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 236/473] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:50 2022] GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07 => generated 1322 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:51.772760 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-847a8016-9eb1-485a-9eff-6a3464106b30 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:51.773706 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-847a8016-9eb1-485a-9eff-6a3464106b30 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:51.776716 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-709aab4d-3582-47de-91d7-4b178378af3e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:51.779655 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-709aab4d-3582-47de-91d7-4b178378af3e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:51.816305 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-709aab4d-3582-47de-91d7-4b178378af3e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:51.816915 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-709aab4d-3582-47de-91d7-4b178378af3e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:51.817437 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-847a8016-9eb1-485a-9eff-6a3464106b30 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:51.818800 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-709aab4d-3582-47de-91d7-4b178378af3e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:51.820250 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-709aab4d-3582-47de-91d7-4b178378af3e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:51.823109 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-847a8016-9eb1-485a-9eff-6a3464106b30 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:51.825092 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-847a8016-9eb1-485a-9eff-6a3464106b30 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:51.828085 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-847a8016-9eb1-485a-9eff-6a3464106b30 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:51.978633 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-709aab4d-3582-47de-91d7-4b178378af3e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 36604 microversion: 2.20 time: 0.208710 Jan 24 09:19:51.979855 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 237/474] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:19:51 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 36604 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:19:52.000183 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-847a8016-9eb1-485a-9eff-6a3464106b30 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 36065 microversion: 2.1 time: 0.238826 Jan 24 09:19:52.006666 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 238/475] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:19:51 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 36065 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:19:52.046296 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-4bd2d1ec-be53-459e-a499-b336c6a798ca tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:52.048322 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-4bd2d1ec-be53-459e-a499-b336c6a798ca tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:52.072145 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4bd2d1ec-be53-459e-a499-b336c6a798ca tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:52.072727 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4bd2d1ec-be53-459e-a499-b336c6a798ca tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:52.074636 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4bd2d1ec-be53-459e-a499-b336c6a798ca tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:52.077829 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4bd2d1ec-be53-459e-a499-b336c6a798ca tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:52.098982 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-94960639-9564-4948-9610-7b62805e0b3a tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:52.099699 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-94960639-9564-4948-9610-7b62805e0b3a tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: d9db33c9-c45f-4643-ad2c-9da35f7ddd07] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:52.110482 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-94960639-9564-4948-9610-7b62805e0b3a tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:52.114274 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-94960639-9564-4948-9610-7b62805e0b3a tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:52.117104 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-94960639-9564-4948-9610-7b62805e0b3a tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:52.117775 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-94960639-9564-4948-9610-7b62805e0b3a tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:52.402358 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-4bd2d1ec-be53-459e-a499-b336c6a798ca tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:52.423686 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-4bd2d1ec-be53-459e-a499-b336c6a798ca tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1525 microversion: 2.1 time: 0.384004 Jan 24 09:19:52.424298 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 238/476] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:52 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1525 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:52.549731 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-94960639-9564-4948-9610-7b62805e0b3a tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:52.560977 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-94960639-9564-4948-9610-7b62805e0b3a tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07" status: 200 len: 1512 microversion: 2.1 time: 0.472848 Jan 24 09:19:52.565346 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 239/477] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:52 2022] GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07 => generated 1512 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:52.990903 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-8b1f98f7-d088-423b-8e19-dec46825ef9d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:52.993249 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-8b1f98f7-d088-423b-8e19-dec46825ef9d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:53.006727 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8b1f98f7-d088-423b-8e19-dec46825ef9d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:53.007183 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8b1f98f7-d088-423b-8e19-dec46825ef9d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:53.011901 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8b1f98f7-d088-423b-8e19-dec46825ef9d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:53.011901 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8b1f98f7-d088-423b-8e19-dec46825ef9d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:53.015707 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-5e992a93-7f29-46d2-add6-eefb39479b0d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:53.016816 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-5e992a93-7f29-46d2-add6-eefb39479b0d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:53.035591 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5e992a93-7f29-46d2-add6-eefb39479b0d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:53.036158 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5e992a93-7f29-46d2-add6-eefb39479b0d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:53.037068 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5e992a93-7f29-46d2-add6-eefb39479b0d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:53.037612 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5e992a93-7f29-46d2-add6-eefb39479b0d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:53.205431 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-5e992a93-7f29-46d2-add6-eefb39479b0d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 36816 microversion: 2.1 time: 0.189242 Jan 24 09:19:53.212281 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 240/478] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:19:53 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 36816 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 09:19:53.233084 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-8b1f98f7-d088-423b-8e19-dec46825ef9d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 38085 microversion: 2.20 time: 0.245059 Jan 24 09:19:53.241712 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 239/479] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:19:52 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 38085 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:19:53.442457 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-9aeed76c-2601-4ba1-8b67-1e414b105a70 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:53.443736 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-9aeed76c-2601-4ba1-8b67-1e414b105a70 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:53.453992 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-9aeed76c-2601-4ba1-8b67-1e414b105a70 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:53.454419 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-9aeed76c-2601-4ba1-8b67-1e414b105a70 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:53.460790 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-9aeed76c-2601-4ba1-8b67-1e414b105a70 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:53.461505 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-9aeed76c-2601-4ba1-8b67-1e414b105a70 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:53.893248 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-9aeed76c-2601-4ba1-8b67-1e414b105a70 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:53.900996 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-9aeed76c-2601-4ba1-8b67-1e414b105a70 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1505 microversion: 2.1 time: 0.463130 Jan 24 09:19:53.911252 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 241/480] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:53 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1505 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:19:53.929248 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-9480de46-f42d-4052-9f3c-d53e054ccfb8 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35d288c7-fada-4abc-bcb4-49757f044aab"}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:53.930605 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-9480de46-f42d-4052-9f3c-d53e054ccfb8 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:53.941528 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9480de46-f42d-4052-9f3c-d53e054ccfb8 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:53.942075 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9480de46-f42d-4052-9f3c-d53e054ccfb8 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:53.943180 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9480de46-f42d-4052-9f3c-d53e054ccfb8 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:53.943785 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9480de46-f42d-4052-9f3c-d53e054ccfb8 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:53.973505 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.wsgi [None req-9480de46-f42d-4052-9f3c-d53e054ccfb8 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] HTTP exception thrown: Cannot 'attach_volume' instance 047cd9d3-84f2-4cb0-a2ff-1439420b4f84 while it is in vm_state rescued Jan 24 09:19:53.974159 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-9480de46-f42d-4052-9f3c-d53e054ccfb8 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Returning 409 to user: Cannot 'attach_volume' instance 047cd9d3-84f2-4cb0-a2ff-1439420b4f84 while it is in vm_state rescued {{(pid=116863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:19:53.975233 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-9480de46-f42d-4052-9f3c-d53e054ccfb8 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "POST /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.051001 Jan 24 09:19:53.976197 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 240/481] 10.222.0.113 () {60 vars in 1327 bytes} [Mon Jan 24 09:19:53 2022] POST /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84/os-volume_attachments => generated 152 bytes in 53 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 24 09:19:53.985405 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-131d8465-25be-41d3-ad4f-dffdf2ba05c0 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:53.986260 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-131d8465-25be-41d3-ad4f-dffdf2ba05c0 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:53.993038 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-131d8465-25be-41d3-ad4f-dffdf2ba05c0 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:53.998004 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-131d8465-25be-41d3-ad4f-dffdf2ba05c0 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:53.998004 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-131d8465-25be-41d3-ad4f-dffdf2ba05c0 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:53.998004 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-131d8465-25be-41d3-ad4f-dffdf2ba05c0 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:54.217711 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-bb931dcb-d726-45d8-8ab1-e4970832c880 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:54.219345 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-bb931dcb-d726-45d8-8ab1-e4970832c880 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:54.236615 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bb931dcb-d726-45d8-8ab1-e4970832c880 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:54.238514 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bb931dcb-d726-45d8-8ab1-e4970832c880 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:54.239502 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bb931dcb-d726-45d8-8ab1-e4970832c880 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:54.240908 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bb931dcb-d726-45d8-8ab1-e4970832c880 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:54.325890 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-131d8465-25be-41d3-ad4f-dffdf2ba05c0 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "POST /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84/action" status: 202 len: 0 microversion: 2.1 time: 0.344265 Jan 24 09:19:54.327334 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 242/482] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:19:53 2022] POST /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84/action => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:19:54.332868 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-6d54184a-d3e5-4682-8f91-597b7c365b12 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:54.339511 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-6d54184a-d3e5-4682-8f91-597b7c365b12 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:54.348646 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6d54184a-d3e5-4682-8f91-597b7c365b12 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:54.349116 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6d54184a-d3e5-4682-8f91-597b7c365b12 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:54.349910 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6d54184a-d3e5-4682-8f91-597b7c365b12 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:54.350518 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6d54184a-d3e5-4682-8f91-597b7c365b12 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:54.404651 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-bb931dcb-d726-45d8-8ab1-e4970832c880 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 37369 microversion: 2.1 time: 0.190060 Jan 24 09:19:54.406477 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 241/483] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:19:54 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 37369 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 09:19:54.413332 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-e6d4c408-3aba-4818-99c1-3b763e592aaf tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:54.415629 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-e6d4c408-3aba-4818-99c1-3b763e592aaf tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:54.425288 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e6d4c408-3aba-4818-99c1-3b763e592aaf tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:54.426476 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e6d4c408-3aba-4818-99c1-3b763e592aaf tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:54.428181 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e6d4c408-3aba-4818-99c1-3b763e592aaf tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:54.428846 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e6d4c408-3aba-4818-99c1-3b763e592aaf tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:54.499191 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-6d54184a-d3e5-4682-8f91-597b7c365b12 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 38441 microversion: 2.20 time: 0.170139 Jan 24 09:19:54.502146 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 243/484] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:19:54 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 38441 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:19:54.671835 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-80a57fd6-7b8e-4c8e-98b4-33300688c06f tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dbf172a8-aab5-4b23-894d-9c12e1182af7"}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:54.675765 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-80a57fd6-7b8e-4c8e-98b4-33300688c06f tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: d9db33c9-c45f-4643-ad2c-9da35f7ddd07] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:54.698323 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-80a57fd6-7b8e-4c8e-98b4-33300688c06f tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:54.700064 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-80a57fd6-7b8e-4c8e-98b4-33300688c06f tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:54.701060 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-80a57fd6-7b8e-4c8e-98b4-33300688c06f tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:54.705600 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-80a57fd6-7b8e-4c8e-98b4-33300688c06f tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:54.708321 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-e6d4c408-3aba-4818-99c1-3b763e592aaf tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:54.727445 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-e6d4c408-3aba-4818-99c1-3b763e592aaf tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1513 microversion: 2.1 time: 0.319194 Jan 24 09:19:54.728399 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 242/485] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:54 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1513 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:55.416852 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-07c148a9-0955-4d80-ad7e-1821edbcdac3 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:55.417757 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-07c148a9-0955-4d80-ad7e-1821edbcdac3 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:55.439974 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-07c148a9-0955-4d80-ad7e-1821edbcdac3 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:55.440442 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-07c148a9-0955-4d80-ad7e-1821edbcdac3 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:55.441208 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-07c148a9-0955-4d80-ad7e-1821edbcdac3 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:55.441639 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-07c148a9-0955-4d80-ad7e-1821edbcdac3 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:55.559344 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-07c148a9-0955-4d80-ad7e-1821edbcdac3 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 38081 microversion: 2.1 time: 0.145988 Jan 24 09:19:55.560145 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 243/486] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:19:55 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 38081 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:19:55.569291 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-f06434a2-6554-4831-b5c8-20c1ff2f9e8f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:55.570894 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-f06434a2-6554-4831-b5c8-20c1ff2f9e8f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:55.583423 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f06434a2-6554-4831-b5c8-20c1ff2f9e8f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:55.584735 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f06434a2-6554-4831-b5c8-20c1ff2f9e8f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:55.585779 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f06434a2-6554-4831-b5c8-20c1ff2f9e8f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:55.586691 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f06434a2-6554-4831-b5c8-20c1ff2f9e8f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:55.706537 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-f06434a2-6554-4831-b5c8-20c1ff2f9e8f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 38441 microversion: 2.20 time: 0.141275 Jan 24 09:19:55.707479 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 244/487] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:19:55 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 38441 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:19:55.745971 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-7c23ef2d-e6b9-4e4d-adad-385922c2556a tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:55.746715 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-7c23ef2d-e6b9-4e4d-adad-385922c2556a tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:55.760106 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7c23ef2d-e6b9-4e4d-adad-385922c2556a tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:55.760762 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7c23ef2d-e6b9-4e4d-adad-385922c2556a tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:55.761569 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7c23ef2d-e6b9-4e4d-adad-385922c2556a tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:55.764950 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7c23ef2d-e6b9-4e4d-adad-385922c2556a tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:55.817960 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-80a57fd6-7b8e-4c8e-98b4-33300688c06f tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "POST /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.167344 Jan 24 09:19:55.823310 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 244/488] 10.222.0.113 () {60 vars in 1327 bytes} [Mon Jan 24 09:19:54 2022] POST /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07/os-volume_attachments => generated 194 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:19:55.990551 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-7c23ef2d-e6b9-4e4d-adad-385922c2556a tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:56.003472 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-7c23ef2d-e6b9-4e4d-adad-385922c2556a tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1513 microversion: 2.1 time: 0.262173 Jan 24 09:19:56.004219 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 245/489] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:55 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1513 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:56.384613 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-59aa6b4f-36ee-4b32-b6b5-74d1f095f005 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Action: 'create', calling method: .version_select at 0x7f473d5dac10>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-760537949"}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:56.399577 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.quota [None req-59aa6b4f-36ee-4b32-b6b5-74d1f095f005 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Getting quotas for project bedaa9b436ab45108aa33633b17e58d0. Resources: {'key_pairs'} {{(pid=116864) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 09:19:56.403096 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.quota [None req-59aa6b4f-36ee-4b32-b6b5-74d1f095f005 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Getting quotas for user 91399ccc8ba64dc7becff56785e9b904 and project bedaa9b436ab45108aa33633b17e58d0. Resources: {'key_pairs'} {{(pid=116864) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 09:19:56.575139 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-972967e6-4677-47f3-a7ec-e9914ab991c0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:56.576631 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-972967e6-4677-47f3-a7ec-e9914ab991c0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:56.585864 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-972967e6-4677-47f3-a7ec-e9914ab991c0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:56.585864 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-972967e6-4677-47f3-a7ec-e9914ab991c0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:56.585864 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-972967e6-4677-47f3-a7ec-e9914ab991c0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:56.585864 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-972967e6-4677-47f3-a7ec-e9914ab991c0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:56.688810 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.quota [None req-59aa6b4f-36ee-4b32-b6b5-74d1f095f005 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Getting quotas for project bedaa9b436ab45108aa33633b17e58d0. Resources: {'key_pairs'} {{(pid=116864) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 09:19:56.693765 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.quota [None req-59aa6b4f-36ee-4b32-b6b5-74d1f095f005 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Getting quotas for user 91399ccc8ba64dc7becff56785e9b904 and project bedaa9b436ab45108aa33633b17e58d0. Resources: {'key_pairs'} {{(pid=116864) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 09:19:56.708272 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-59aa6b4f-36ee-4b32-b6b5-74d1f095f005 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.657360 Jan 24 09:19:56.708827 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 245/490] 10.222.0.113 () {60 vars in 1162 bytes} [Mon Jan 24 09:19:56 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:56.719877 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-71e5b235-c199-4211-963e-49c54a2b17dc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:56.720932 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-71e5b235-c199-4211-963e-49c54a2b17dc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:56.723274 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-972967e6-4677-47f3-a7ec-e9914ab991c0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 38475 microversion: 2.1 time: 0.154066 Jan 24 09:19:56.724216 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 246/491] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:19:56 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 38475 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:19:56.728388 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-71e5b235-c199-4211-963e-49c54a2b17dc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:56.728915 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-71e5b235-c199-4211-963e-49c54a2b17dc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:56.729964 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-71e5b235-c199-4211-963e-49c54a2b17dc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:56.730506 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-71e5b235-c199-4211-963e-49c54a2b17dc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:56.815481 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-71e5b235-c199-4211-963e-49c54a2b17dc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 38441 microversion: 2.20 time: 0.099674 Jan 24 09:19:56.817483 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 246/492] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:19:56 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 38441 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 09:19:57.022580 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-fb0c2994-d43f-4624-b94f-832f2aa83b4f tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:57.023408 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-fb0c2994-d43f-4624-b94f-832f2aa83b4f tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:57.030685 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-fb0c2994-d43f-4624-b94f-832f2aa83b4f tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:57.031255 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-fb0c2994-d43f-4624-b94f-832f2aa83b4f tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:57.032115 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-fb0c2994-d43f-4624-b94f-832f2aa83b4f tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:57.032625 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-fb0c2994-d43f-4624-b94f-832f2aa83b4f tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:57.206136 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-fb0c2994-d43f-4624-b94f-832f2aa83b4f tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:57.215032 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-fb0c2994-d43f-4624-b94f-832f2aa83b4f tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1513 microversion: 2.1 time: 0.197173 Jan 24 09:19:57.217264 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 247/493] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:57 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1513 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:57.737054 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-b05b2943-07ca-4026-b658-26d12bbeb413 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:57.738179 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-b05b2943-07ca-4026-b658-26d12bbeb413 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:57.745076 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b05b2943-07ca-4026-b658-26d12bbeb413 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:57.750638 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b05b2943-07ca-4026-b658-26d12bbeb413 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:57.750638 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b05b2943-07ca-4026-b658-26d12bbeb413 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:57.750638 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b05b2943-07ca-4026-b658-26d12bbeb413 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:57.831895 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-44e67e58-6369-43ad-9c69-fd0e88365807 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:19:57.832834 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-44e67e58-6369-43ad-9c69-fd0e88365807 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:57.842008 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-44e67e58-6369-43ad-9c69-fd0e88365807 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:57.842737 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-44e67e58-6369-43ad-9c69-fd0e88365807 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:57.843984 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-b05b2943-07ca-4026-b658-26d12bbeb413 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 200 len: 38617 microversion: 2.1 time: 0.109838 Jan 24 09:19:57.845148 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-44e67e58-6369-43ad-9c69-fd0e88365807 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:57.845835 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-44e67e58-6369-43ad-9c69-fd0e88365807 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:57.849714 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 247/494] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:19:57 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 38617 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:19:57.858869 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-a578d1b4-31a2-4d95-bc78-f36a56292932 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:57.859699 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-a578d1b4-31a2-4d95-bc78-f36a56292932 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:57.870568 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a578d1b4-31a2-4d95-bc78-f36a56292932 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:57.873661 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a578d1b4-31a2-4d95-bc78-f36a56292932 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:57.876292 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a578d1b4-31a2-4d95-bc78-f36a56292932 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:57.876694 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a578d1b4-31a2-4d95-bc78-f36a56292932 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:57.907331 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-a578d1b4-31a2-4d95-bc78-f36a56292932 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/ips" status: 200 len: 145 microversion: 2.1 time: 0.056277 Jan 24 09:19:57.908257 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 248/495] 10.222.0.113 () {58 vars in 1252 bytes} [Mon Jan 24 09:19:57 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/ips => generated 145 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:19:57.999130 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-44e67e58-6369-43ad-9c69-fd0e88365807 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 200 len: 38583 microversion: 2.20 time: 0.170462 Jan 24 09:19:58.000396 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 248/496] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:19:57 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 38583 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 09:19:58.010038 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-f8962808-fd6a-4c92-b74e-608678cc7bd2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:58.010434 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-f8962808-fd6a-4c92-b74e-608678cc7bd2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:58.019695 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f8962808-fd6a-4c92-b74e-608678cc7bd2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:58.025288 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f8962808-fd6a-4c92-b74e-608678cc7bd2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:58.026493 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f8962808-fd6a-4c92-b74e-608678cc7bd2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:58.030328 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f8962808-fd6a-4c92-b74e-608678cc7bd2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:58.060619 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-f8962808-fd6a-4c92-b74e-608678cc7bd2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/ips" status: 200 len: 151 microversion: 2.20 time: 0.054254 Jan 24 09:19:58.062991 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 249/497] 10.222.0.113 () {60 vars in 1293 bytes} [Mon Jan 24 09:19:58 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/ips => generated 151 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:19:58.233907 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-1063e8c0-575f-4601-b399-633ff501b9d2 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:58.234652 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-1063e8c0-575f-4601-b399-633ff501b9d2 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:58.249251 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1063e8c0-575f-4601-b399-633ff501b9d2 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:58.251944 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1063e8c0-575f-4601-b399-633ff501b9d2 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:58.254492 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1063e8c0-575f-4601-b399-633ff501b9d2 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:58.256690 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1063e8c0-575f-4601-b399-633ff501b9d2 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:58.500643 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-1063e8c0-575f-4601-b399-633ff501b9d2 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:58.510856 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-1063e8c0-575f-4601-b399-633ff501b9d2 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1513 microversion: 2.1 time: 0.281451 Jan 24 09:19:58.511421 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 249/498] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:58 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1513 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:19:59.529629 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-5f4c0b74-987d-4a90-8361-3804cf57c621 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:19:59.530303 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-5f4c0b74-987d-4a90-8361-3804cf57c621 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:19:59.536971 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5f4c0b74-987d-4a90-8361-3804cf57c621 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:59.537448 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5f4c0b74-987d-4a90-8361-3804cf57c621 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:59.538287 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5f4c0b74-987d-4a90-8361-3804cf57c621 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:19:59.538725 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5f4c0b74-987d-4a90-8361-3804cf57c621 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:19:59.737941 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-5f4c0b74-987d-4a90-8361-3804cf57c621 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:19:59.746264 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-5f4c0b74-987d-4a90-8361-3804cf57c621 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1519 microversion: 2.1 time: 0.220859 Jan 24 09:19:59.747838 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 250/499] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:19:59 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1519 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:01.553895 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-54bc9d5e-20ee-4c91-a7fe-b3bcd037e7de tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:20:01.554498 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-54bc9d5e-20ee-4c91-a7fe-b3bcd037e7de tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:01.561070 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-54bc9d5e-20ee-4c91-a7fe-b3bcd037e7de tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:01.561523 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-54bc9d5e-20ee-4c91-a7fe-b3bcd037e7de tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:01.562363 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-54bc9d5e-20ee-4c91-a7fe-b3bcd037e7de tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:01.562834 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-54bc9d5e-20ee-4c91-a7fe-b3bcd037e7de tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:01.588331 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.objects.instance [None req-54bc9d5e-20ee-4c91-a7fe-b3bcd037e7de tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lazy-loading 'flavor' on Instance uuid b820c156-179a-4172-a02b-6c88713087f1 {{(pid=116863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 09:20:01.593731 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-c7abd012-3a8e-4bc6-a592-876ee4b52c6d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dcc5b842-485e-4c76-82fc-267f65928855"}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:20:01.595233 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-c7abd012-3a8e-4bc6-a592-876ee4b52c6d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:01.602150 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c7abd012-3a8e-4bc6-a592-876ee4b52c6d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:01.602600 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c7abd012-3a8e-4bc6-a592-876ee4b52c6d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:01.603385 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c7abd012-3a8e-4bc6-a592-876ee4b52c6d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:01.603816 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c7abd012-3a8e-4bc6-a592-876ee4b52c6d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:02.295870 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-54bc9d5e-20ee-4c91-a7fe-b3bcd037e7de tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 202 len: 0 microversion: 2.20 time: 0.745943 Jan 24 09:20:02.296658 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 250/500] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:20:01 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 0 bytes in 748 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 24 09:20:02.305571 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-b979fb51-86c9-48bc-8b51-080cb5469df8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:02.306290 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-b979fb51-86c9-48bc-8b51-080cb5469df8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:02.313205 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b979fb51-86c9-48bc-8b51-080cb5469df8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:02.313652 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b979fb51-86c9-48bc-8b51-080cb5469df8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:02.314451 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b979fb51-86c9-48bc-8b51-080cb5469df8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:02.314911 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b979fb51-86c9-48bc-8b51-080cb5469df8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:02.452153 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-b979fb51-86c9-48bc-8b51-080cb5469df8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:02.460129 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-b979fb51-86c9-48bc-8b51-080cb5469df8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:02.461626 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-b979fb51-86c9-48bc-8b51-080cb5469df8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:02.462891 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-b979fb51-86c9-48bc-8b51-080cb5469df8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1727 microversion: 2.20 time: 0.161358 Jan 24 09:20:02.463448 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 251/501] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:20:02 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:20:02.737026 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-7c6b8e88-c4ed-4079-ac49-44b980826432 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:02.737026 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-7c6b8e88-c4ed-4079-ac49-44b980826432 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:02.743550 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7c6b8e88-c4ed-4079-ac49-44b980826432 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:02.744109 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7c6b8e88-c4ed-4079-ac49-44b980826432 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:02.744914 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7c6b8e88-c4ed-4079-ac49-44b980826432 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:02.745322 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7c6b8e88-c4ed-4079-ac49-44b980826432 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:02.782699 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-c7abd012-3a8e-4bc6-a592-876ee4b52c6d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.196048 Jan 24 09:20:02.785093 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 251/502] 10.222.0.113 () {60 vars in 1327 bytes} [Mon Jan 24 09:20:01 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/os-volume_attachments => generated 194 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 09:20:02.924646 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-7c6b8e88-c4ed-4079-ac49-44b980826432 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:02.932716 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-7c6b8e88-c4ed-4079-ac49-44b980826432 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1519 microversion: 2.1 time: 0.201454 Jan 24 09:20:02.933294 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 252/503] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:02 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1519 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:02.952485 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-d13a9e61-79e9-47f8-b247-acf29ea5fec5 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "30bdf825-81d0-458d-8a06-ca5e9985b57e"}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:20:02.953963 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-d13a9e61-79e9-47f8-b247-acf29ea5fec5 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:02.964015 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d13a9e61-79e9-47f8-b247-acf29ea5fec5 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:02.964507 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d13a9e61-79e9-47f8-b247-acf29ea5fec5 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:02.965374 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d13a9e61-79e9-47f8-b247-acf29ea5fec5 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:02.965820 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d13a9e61-79e9-47f8-b247-acf29ea5fec5 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:03.482190 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-b62ca052-dcf3-4e5c-95e4-6d3b33649c56 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:03.483494 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-b62ca052-dcf3-4e5c-95e4-6d3b33649c56 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:03.490057 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b62ca052-dcf3-4e5c-95e4-6d3b33649c56 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:03.490528 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b62ca052-dcf3-4e5c-95e4-6d3b33649c56 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:03.491299 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b62ca052-dcf3-4e5c-95e4-6d3b33649c56 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:03.491727 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b62ca052-dcf3-4e5c-95e4-6d3b33649c56 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:03.672008 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-b62ca052-dcf3-4e5c-95e4-6d3b33649c56 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:03.680565 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-b62ca052-dcf3-4e5c-95e4-6d3b33649c56 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:03.682066 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-b62ca052-dcf3-4e5c-95e4-6d3b33649c56 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:03.683253 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-b62ca052-dcf3-4e5c-95e4-6d3b33649c56 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1727 microversion: 2.20 time: 0.204777 Jan 24 09:20:03.683871 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 253/504] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:20:03 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1727 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 09:20:04.100321 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-d13a9e61-79e9-47f8-b247-acf29ea5fec5 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "POST /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.152988 Jan 24 09:20:04.100977 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 252/505] 10.222.0.113 () {60 vars in 1327 bytes} [Mon Jan 24 09:20:02 2022] POST /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84/os-volume_attachments => generated 194 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:20:04.704255 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-ff4a79eb-2c26-4243-ad4b-362456a247b4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:04.704869 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-ff4a79eb-2c26-4243-ad4b-362456a247b4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:04.711609 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ff4a79eb-2c26-4243-ad4b-362456a247b4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:04.712065 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ff4a79eb-2c26-4243-ad4b-362456a247b4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:04.713067 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ff4a79eb-2c26-4243-ad4b-362456a247b4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:04.713388 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ff4a79eb-2c26-4243-ad4b-362456a247b4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:04.831775 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-540a18f7-5bde-4329-95e1-c2681131a635 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:04.832778 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-540a18f7-5bde-4329-95e1-c2681131a635 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: d9db33c9-c45f-4643-ad2c-9da35f7ddd07] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:04.841344 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-540a18f7-5bde-4329-95e1-c2681131a635 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:04.844215 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-540a18f7-5bde-4329-95e1-c2681131a635 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:04.845405 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-540a18f7-5bde-4329-95e1-c2681131a635 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:04.846026 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-540a18f7-5bde-4329-95e1-c2681131a635 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:04.876297 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-ff4a79eb-2c26-4243-ad4b-362456a247b4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:04.884509 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-ff4a79eb-2c26-4243-ad4b-362456a247b4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:04.886266 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-ff4a79eb-2c26-4243-ad4b-362456a247b4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:04.887433 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-ff4a79eb-2c26-4243-ad4b-362456a247b4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1727 microversion: 2.20 time: 0.187680 Jan 24 09:20:04.890155 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 254/506] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:20:04 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1727 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:20:04.937460 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.objects.instance [None req-540a18f7-5bde-4329-95e1-c2681131a635 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lazy-loading 'services' on Instance uuid d9db33c9-c45f-4643-ad2c-9da35f7ddd07 {{(pid=116864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 09:20:05.213558 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-540a18f7-5bde-4329-95e1-c2681131a635 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "DELETE /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07/os-volume_attachments/dbf172a8-aab5-4b23-894d-9c12e1182af7" status: 202 len: 0 microversion: 2.1 time: 0.387300 Jan 24 09:20:05.214383 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 253/507] 10.222.0.113 () {58 vars in 1420 bytes} [Mon Jan 24 09:20:04 2022] DELETE /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07/os-volume_attachments/dbf172a8-aab5-4b23-894d-9c12e1182af7 => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:20:05.222428 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-1561d3ff-9bb0-45f7-9133-addde2912aae tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:05.223408 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-1561d3ff-9bb0-45f7-9133-addde2912aae tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: d9db33c9-c45f-4643-ad2c-9da35f7ddd07] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:05.229593 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1561d3ff-9bb0-45f7-9133-addde2912aae tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:05.230036 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1561d3ff-9bb0-45f7-9133-addde2912aae tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:05.230854 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1561d3ff-9bb0-45f7-9133-addde2912aae tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:05.231283 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1561d3ff-9bb0-45f7-9133-addde2912aae tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:05.261512 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-1561d3ff-9bb0-45f7-9133-addde2912aae tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042907 Jan 24 09:20:05.262191 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 255/508] 10.222.0.113 () {58 vars in 1306 bytes} [Mon Jan 24 09:20:05 2022] GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:20:05.910773 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-e8be3dea-0748-4364-8adf-c4ecc938349c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:05.911674 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-e8be3dea-0748-4364-8adf-c4ecc938349c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:05.917895 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e8be3dea-0748-4364-8adf-c4ecc938349c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:05.918488 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e8be3dea-0748-4364-8adf-c4ecc938349c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:05.919424 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e8be3dea-0748-4364-8adf-c4ecc938349c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:05.919991 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e8be3dea-0748-4364-8adf-c4ecc938349c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:06.068319 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-e8be3dea-0748-4364-8adf-c4ecc938349c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:06.077294 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-e8be3dea-0748-4364-8adf-c4ecc938349c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:06.079128 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-e8be3dea-0748-4364-8adf-c4ecc938349c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:06.080294 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-e8be3dea-0748-4364-8adf-c4ecc938349c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1727 microversion: 2.20 time: 0.175826 Jan 24 09:20:06.080863 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 254/509] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:20:05 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1727 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:20:06.273447 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-6b4a4af3-44c7-4d2b-a613-72c858ec2168 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:06.275101 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-6b4a4af3-44c7-4d2b-a613-72c858ec2168 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: d9db33c9-c45f-4643-ad2c-9da35f7ddd07] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:06.281867 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6b4a4af3-44c7-4d2b-a613-72c858ec2168 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:06.282369 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6b4a4af3-44c7-4d2b-a613-72c858ec2168 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:06.283349 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6b4a4af3-44c7-4d2b-a613-72c858ec2168 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:06.284118 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6b4a4af3-44c7-4d2b-a613-72c858ec2168 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:06.317126 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-6b4a4af3-44c7-4d2b-a613-72c858ec2168 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048060 Jan 24 09:20:06.317870 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 256/510] 10.222.0.113 () {58 vars in 1306 bytes} [Mon Jan 24 09:20:06 2022] GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:20:07.098369 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-b66e7b1d-7c09-4f70-b10b-8c8241489d84 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:07.098879 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-b66e7b1d-7c09-4f70-b10b-8c8241489d84 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:07.105130 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b66e7b1d-7c09-4f70-b10b-8c8241489d84 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:07.105577 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b66e7b1d-7c09-4f70-b10b-8c8241489d84 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:07.106384 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b66e7b1d-7c09-4f70-b10b-8c8241489d84 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:07.106811 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b66e7b1d-7c09-4f70-b10b-8c8241489d84 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:07.250275 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-b66e7b1d-7c09-4f70-b10b-8c8241489d84 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:07.258986 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-b66e7b1d-7c09-4f70-b10b-8c8241489d84 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:07.260342 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-b66e7b1d-7c09-4f70-b10b-8c8241489d84 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:07.261702 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-b66e7b1d-7c09-4f70-b10b-8c8241489d84 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1727 microversion: 2.20 time: 0.166935 Jan 24 09:20:07.262272 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 255/511] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:20:07 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:20:07.328575 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-90ba908b-4985-412f-8e16-e0a18c582157 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:07.329502 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-90ba908b-4985-412f-8e16-e0a18c582157 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: d9db33c9-c45f-4643-ad2c-9da35f7ddd07] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:07.335907 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-90ba908b-4985-412f-8e16-e0a18c582157 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:07.336363 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-90ba908b-4985-412f-8e16-e0a18c582157 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:07.337185 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-90ba908b-4985-412f-8e16-e0a18c582157 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:07.337624 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-90ba908b-4985-412f-8e16-e0a18c582157 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:07.379305 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-90ba908b-4985-412f-8e16-e0a18c582157 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054483 Jan 24 09:20:07.379895 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 257/512] 10.222.0.113 () {58 vars in 1306 bytes} [Mon Jan 24 09:20:07 2022] GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:20:08.280263 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-d7dd7146-df48-4267-9bf3-50e803d469b2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:08.281086 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-d7dd7146-df48-4267-9bf3-50e803d469b2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:08.288579 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d7dd7146-df48-4267-9bf3-50e803d469b2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:08.289027 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d7dd7146-df48-4267-9bf3-50e803d469b2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:08.290033 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d7dd7146-df48-4267-9bf3-50e803d469b2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:08.290560 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d7dd7146-df48-4267-9bf3-50e803d469b2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:08.390984 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-a14fd4a3-aeae-4bca-bb84-786be516785b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:08.392301 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-a14fd4a3-aeae-4bca-bb84-786be516785b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: d9db33c9-c45f-4643-ad2c-9da35f7ddd07] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:08.399967 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a14fd4a3-aeae-4bca-bb84-786be516785b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:08.400419 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a14fd4a3-aeae-4bca-bb84-786be516785b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:08.401434 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a14fd4a3-aeae-4bca-bb84-786be516785b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:08.401870 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a14fd4a3-aeae-4bca-bb84-786be516785b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:08.435523 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-a14fd4a3-aeae-4bca-bb84-786be516785b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048106 Jan 24 09:20:08.436586 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 258/513] 10.222.0.113 () {58 vars in 1306 bytes} [Mon Jan 24 09:20:08 2022] GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 09:20:08.441403 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-d7dd7146-df48-4267-9bf3-50e803d469b2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:08.451194 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-d7dd7146-df48-4267-9bf3-50e803d469b2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:08.452761 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-d7dd7146-df48-4267-9bf3-50e803d469b2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:08.453926 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-d7dd7146-df48-4267-9bf3-50e803d469b2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1727 microversion: 2.20 time: 0.177418 Jan 24 09:20:08.454523 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 256/514] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:20:08 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1727 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:20:09.448301 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-cbd6ef41-57c3-4853-b8d9-674070f5b142 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:09.449251 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-cbd6ef41-57c3-4853-b8d9-674070f5b142 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: d9db33c9-c45f-4643-ad2c-9da35f7ddd07] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:09.456214 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-cbd6ef41-57c3-4853-b8d9-674070f5b142 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:09.456666 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-cbd6ef41-57c3-4853-b8d9-674070f5b142 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:09.457449 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-cbd6ef41-57c3-4853-b8d9-674070f5b142 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:09.457885 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-cbd6ef41-57c3-4853-b8d9-674070f5b142 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:09.472692 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-f2b780c7-8864-4ae7-87da-652c72a8cf4d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:09.473329 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-f2b780c7-8864-4ae7-87da-652c72a8cf4d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:09.479785 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f2b780c7-8864-4ae7-87da-652c72a8cf4d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:09.482986 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f2b780c7-8864-4ae7-87da-652c72a8cf4d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:09.482986 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f2b780c7-8864-4ae7-87da-652c72a8cf4d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:09.482986 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f2b780c7-8864-4ae7-87da-652c72a8cf4d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:09.491761 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-cbd6ef41-57c3-4853-b8d9-674070f5b142 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047346 Jan 24 09:20:09.492356 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 259/515] 10.222.0.113 () {58 vars in 1306 bytes} [Mon Jan 24 09:20:09 2022] GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:20:09.618786 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-f2b780c7-8864-4ae7-87da-652c72a8cf4d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:09.627098 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-f2b780c7-8864-4ae7-87da-652c72a8cf4d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:09.628590 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-f2b780c7-8864-4ae7-87da-652c72a8cf4d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:09.629759 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-f2b780c7-8864-4ae7-87da-652c72a8cf4d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1727 microversion: 2.20 time: 0.161623 Jan 24 09:20:09.630361 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 257/516] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:20:09 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 09:20:10.503977 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-7b060bcd-db8b-4dda-87ad-6ff48024581c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:10.509180 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-7b060bcd-db8b-4dda-87ad-6ff48024581c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: d9db33c9-c45f-4643-ad2c-9da35f7ddd07] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:10.511623 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7b060bcd-db8b-4dda-87ad-6ff48024581c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:10.512068 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7b060bcd-db8b-4dda-87ad-6ff48024581c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:10.512839 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7b060bcd-db8b-4dda-87ad-6ff48024581c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:10.513376 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7b060bcd-db8b-4dda-87ad-6ff48024581c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:10.543007 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-7b060bcd-db8b-4dda-87ad-6ff48024581c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043643 Jan 24 09:20:10.543570 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 260/517] 10.222.0.113 () {58 vars in 1306 bytes} [Mon Jan 24 09:20:10 2022] GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:20:10.647654 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-197f140d-41eb-4ebd-a910-74756bf0718a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:10.648265 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-197f140d-41eb-4ebd-a910-74756bf0718a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:10.654600 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-197f140d-41eb-4ebd-a910-74756bf0718a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:10.655043 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-197f140d-41eb-4ebd-a910-74756bf0718a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:10.655878 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-197f140d-41eb-4ebd-a910-74756bf0718a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:10.656311 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-197f140d-41eb-4ebd-a910-74756bf0718a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:10.792627 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-197f140d-41eb-4ebd-a910-74756bf0718a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:10.801921 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-197f140d-41eb-4ebd-a910-74756bf0718a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:10.803457 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-197f140d-41eb-4ebd-a910-74756bf0718a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:10.804612 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-197f140d-41eb-4ebd-a910-74756bf0718a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1727 microversion: 2.20 time: 0.160734 Jan 24 09:20:10.805173 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 258/518] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:20:10 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:20:11.556735 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-19383d1d-c67c-441b-8fa9-39cb59b7c01e tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:11.557649 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-19383d1d-c67c-441b-8fa9-39cb59b7c01e tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: d9db33c9-c45f-4643-ad2c-9da35f7ddd07] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:11.565034 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-19383d1d-c67c-441b-8fa9-39cb59b7c01e tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:11.565500 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-19383d1d-c67c-441b-8fa9-39cb59b7c01e tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:11.566359 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-19383d1d-c67c-441b-8fa9-39cb59b7c01e tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:11.566808 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-19383d1d-c67c-441b-8fa9-39cb59b7c01e tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:11.602386 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-19383d1d-c67c-441b-8fa9-39cb59b7c01e tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049805 Jan 24 09:20:11.602961 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 261/519] 10.222.0.113 () {58 vars in 1306 bytes} [Mon Jan 24 09:20:11 2022] GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:20:11.824695 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-272d3a73-f369-4e53-9e60-6e3550e4434b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:11.825915 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-272d3a73-f369-4e53-9e60-6e3550e4434b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:11.834377 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-272d3a73-f369-4e53-9e60-6e3550e4434b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:11.834872 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-272d3a73-f369-4e53-9e60-6e3550e4434b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:11.835663 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-272d3a73-f369-4e53-9e60-6e3550e4434b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:11.836106 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-272d3a73-f369-4e53-9e60-6e3550e4434b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:11.974029 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-272d3a73-f369-4e53-9e60-6e3550e4434b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:11.982061 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-272d3a73-f369-4e53-9e60-6e3550e4434b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:11.983631 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-272d3a73-f369-4e53-9e60-6e3550e4434b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:11.984865 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-272d3a73-f369-4e53-9e60-6e3550e4434b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1727 microversion: 2.20 time: 0.164068 Jan 24 09:20:11.985425 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 259/520] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:20:11 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:20:12.613624 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-a4b5c93d-b271-415c-b386-b7963ea50207 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:12.622745 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-a4b5c93d-b271-415c-b386-b7963ea50207 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: d9db33c9-c45f-4643-ad2c-9da35f7ddd07] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:12.622745 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a4b5c93d-b271-415c-b386-b7963ea50207 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:12.622745 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a4b5c93d-b271-415c-b386-b7963ea50207 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:12.622745 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a4b5c93d-b271-415c-b386-b7963ea50207 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:12.623170 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a4b5c93d-b271-415c-b386-b7963ea50207 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:12.652427 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-a4b5c93d-b271-415c-b386-b7963ea50207 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043254 Jan 24 09:20:12.653037 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 262/521] 10.222.0.113 () {58 vars in 1306 bytes} [Mon Jan 24 09:20:12 2022] GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:20:13.003423 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-75043680-be38-401d-850c-65ab9a84713e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:13.004059 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-75043680-be38-401d-850c-65ab9a84713e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:13.011737 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-75043680-be38-401d-850c-65ab9a84713e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:13.012193 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-75043680-be38-401d-850c-65ab9a84713e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:13.012979 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-75043680-be38-401d-850c-65ab9a84713e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:13.013441 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-75043680-be38-401d-850c-65ab9a84713e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:13.148651 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-75043680-be38-401d-850c-65ab9a84713e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:13.156384 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-75043680-be38-401d-850c-65ab9a84713e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:13.157899 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-75043680-be38-401d-850c-65ab9a84713e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:13.159800 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-75043680-be38-401d-850c-65ab9a84713e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1727 microversion: 2.20 time: 0.160343 Jan 24 09:20:13.160373 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 260/522] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:20:12 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:20:13.664212 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-0cee1808-b85d-4665-adfa-6b6281f1362e tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:13.665128 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-0cee1808-b85d-4665-adfa-6b6281f1362e tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: d9db33c9-c45f-4643-ad2c-9da35f7ddd07] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:13.671542 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0cee1808-b85d-4665-adfa-6b6281f1362e tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:13.672028 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0cee1808-b85d-4665-adfa-6b6281f1362e tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:13.672822 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0cee1808-b85d-4665-adfa-6b6281f1362e tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:13.673263 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0cee1808-b85d-4665-adfa-6b6281f1362e tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:13.704080 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-0cee1808-b85d-4665-adfa-6b6281f1362e tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043497 Jan 24 09:20:13.704571 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 263/523] 10.222.0.113 () {58 vars in 1306 bytes} [Mon Jan 24 09:20:13 2022] GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:20:14.181157 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-46cd331d-5982-43cd-9ab1-9e5f041b816c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:14.182685 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-46cd331d-5982-43cd-9ab1-9e5f041b816c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:14.191491 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-46cd331d-5982-43cd-9ab1-9e5f041b816c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:14.191935 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-46cd331d-5982-43cd-9ab1-9e5f041b816c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:14.192902 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-46cd331d-5982-43cd-9ab1-9e5f041b816c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:14.193165 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-46cd331d-5982-43cd-9ab1-9e5f041b816c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:14.339795 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-46cd331d-5982-43cd-9ab1-9e5f041b816c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:14.348442 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-46cd331d-5982-43cd-9ab1-9e5f041b816c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:14.358762 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-46cd331d-5982-43cd-9ab1-9e5f041b816c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:14.358762 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-46cd331d-5982-43cd-9ab1-9e5f041b816c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1727 microversion: 2.20 time: 0.176685 Jan 24 09:20:14.358762 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 261/524] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:20:14 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1727 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:20:14.716701 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-4cce317d-1257-488c-ae94-eacaa633d030 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:14.717664 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-4cce317d-1257-488c-ae94-eacaa633d030 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: d9db33c9-c45f-4643-ad2c-9da35f7ddd07] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:14.726187 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4cce317d-1257-488c-ae94-eacaa633d030 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:14.726651 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4cce317d-1257-488c-ae94-eacaa633d030 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:14.727530 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4cce317d-1257-488c-ae94-eacaa633d030 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:14.727946 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4cce317d-1257-488c-ae94-eacaa633d030 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:14.760926 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-4cce317d-1257-488c-ae94-eacaa633d030 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048306 Jan 24 09:20:14.761500 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 264/525] 10.222.0.113 () {58 vars in 1306 bytes} [Mon Jan 24 09:20:14 2022] GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:20:15.375426 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-c5a917b4-b6e5-44bd-82b7-889280c4f64f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:15.376046 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-c5a917b4-b6e5-44bd-82b7-889280c4f64f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:15.383090 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c5a917b4-b6e5-44bd-82b7-889280c4f64f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:15.383470 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c5a917b4-b6e5-44bd-82b7-889280c4f64f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:15.384249 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c5a917b4-b6e5-44bd-82b7-889280c4f64f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:15.384677 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c5a917b4-b6e5-44bd-82b7-889280c4f64f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:15.537338 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-c5a917b4-b6e5-44bd-82b7-889280c4f64f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:15.541831 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-c5a917b4-b6e5-44bd-82b7-889280c4f64f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:15.543360 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-c5a917b4-b6e5-44bd-82b7-889280c4f64f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:15.544612 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-c5a917b4-b6e5-44bd-82b7-889280c4f64f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1727 microversion: 2.20 time: 0.172791 Jan 24 09:20:15.545113 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 262/526] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:20:15 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:20:15.767627 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-808340c9-a90d-410e-ad2b-ebe2dc2923f5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:20:15.773228 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-ede6b977-42c9-4e42-938b-619389dc5c54 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:15.774353 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-ede6b977-42c9-4e42-938b-619389dc5c54 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: d9db33c9-c45f-4643-ad2c-9da35f7ddd07] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:15.775214 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-808340c9-a90d-410e-ad2b-ebe2dc2923f5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:15.775717 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-808340c9-a90d-410e-ad2b-ebe2dc2923f5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:15.780646 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ede6b977-42c9-4e42-938b-619389dc5c54 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:15.781230 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ede6b977-42c9-4e42-938b-619389dc5c54 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:15.782146 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ede6b977-42c9-4e42-938b-619389dc5c54 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:15.782665 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ede6b977-42c9-4e42-938b-619389dc5c54 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:15.816220 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-ede6b977-42c9-4e42-938b-619389dc5c54 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046977 Jan 24 09:20:15.816785 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 263/527] 10.222.0.113 () {58 vars in 1306 bytes} [Mon Jan 24 09:20:15 2022] GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 09:20:15.839396 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-808340c9-a90d-410e-ad2b-ebe2dc2923f5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Going to try to stop instance {{(pid=116863) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 24 09:20:16.119091 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-808340c9-a90d-410e-ad2b-ebe2dc2923f5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 202 len: 0 microversion: 2.1 time: 0.355241 Jan 24 09:20:16.119697 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 265/528] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:20:15 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:20:16.128180 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-fa593d8e-a676-4773-94f5-81ca304e35fe tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:16.128811 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-fa593d8e-a676-4773-94f5-81ca304e35fe tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:16.135831 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fa593d8e-a676-4773-94f5-81ca304e35fe tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:16.136612 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fa593d8e-a676-4773-94f5-81ca304e35fe tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:16.137582 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fa593d8e-a676-4773-94f5-81ca304e35fe tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:16.138019 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fa593d8e-a676-4773-94f5-81ca304e35fe tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:16.294202 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-fa593d8e-a676-4773-94f5-81ca304e35fe tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:16.302808 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-fa593d8e-a676-4773-94f5-81ca304e35fe tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1726 microversion: 2.1 time: 0.178921 Jan 24 09:20:16.303390 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 264/529] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:16 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1726 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:16.563333 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-ab0d01b3-6d03-4c28-a72c-35e68d8f43f6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:16.564198 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-ab0d01b3-6d03-4c28-a72c-35e68d8f43f6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:16.571616 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ab0d01b3-6d03-4c28-a72c-35e68d8f43f6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:16.572068 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ab0d01b3-6d03-4c28-a72c-35e68d8f43f6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:16.572858 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ab0d01b3-6d03-4c28-a72c-35e68d8f43f6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:16.573287 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ab0d01b3-6d03-4c28-a72c-35e68d8f43f6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:16.728999 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-ab0d01b3-6d03-4c28-a72c-35e68d8f43f6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:16.737880 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-ab0d01b3-6d03-4c28-a72c-35e68d8f43f6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:16.739445 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-ab0d01b3-6d03-4c28-a72c-35e68d8f43f6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:16.740599 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-ab0d01b3-6d03-4c28-a72c-35e68d8f43f6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1727 microversion: 2.20 time: 0.181334 Jan 24 09:20:16.742383 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 266/530] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:20:16 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1727 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:20:16.827688 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-43425654-815e-4566-b1e9-ac9195c4d975 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:16.828630 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-43425654-815e-4566-b1e9-ac9195c4d975 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: d9db33c9-c45f-4643-ad2c-9da35f7ddd07] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:16.835553 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-43425654-815e-4566-b1e9-ac9195c4d975 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:16.836011 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-43425654-815e-4566-b1e9-ac9195c4d975 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:16.836805 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-43425654-815e-4566-b1e9-ac9195c4d975 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:16.837243 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-43425654-815e-4566-b1e9-ac9195c4d975 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:16.867427 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-43425654-815e-4566-b1e9-ac9195c4d975 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043441 Jan 24 09:20:16.867995 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 265/531] 10.222.0.113 () {58 vars in 1306 bytes} [Mon Jan 24 09:20:16 2022] GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:20:17.320966 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-d48b5a82-26f8-4fd4-80bd-b60cbd4b8633 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:17.321659 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-d48b5a82-26f8-4fd4-80bd-b60cbd4b8633 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:17.328574 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d48b5a82-26f8-4fd4-80bd-b60cbd4b8633 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:17.329023 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d48b5a82-26f8-4fd4-80bd-b60cbd4b8633 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:17.329920 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d48b5a82-26f8-4fd4-80bd-b60cbd4b8633 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:17.330490 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d48b5a82-26f8-4fd4-80bd-b60cbd4b8633 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:17.484793 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-d48b5a82-26f8-4fd4-80bd-b60cbd4b8633 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:17.493057 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-d48b5a82-26f8-4fd4-80bd-b60cbd4b8633 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1726 microversion: 2.1 time: 0.175658 Jan 24 09:20:17.503439 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 267/532] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:17 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1726 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:17.758735 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-3d610dd9-ae2e-48a4-a9c7-76e26be0f8d7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:17.759535 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-3d610dd9-ae2e-48a4-a9c7-76e26be0f8d7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:17.765749 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3d610dd9-ae2e-48a4-a9c7-76e26be0f8d7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:17.766227 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3d610dd9-ae2e-48a4-a9c7-76e26be0f8d7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:17.766999 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3d610dd9-ae2e-48a4-a9c7-76e26be0f8d7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:17.767442 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3d610dd9-ae2e-48a4-a9c7-76e26be0f8d7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:17.880688 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-6f00a749-a5a5-4d65-9b71-60daa80ddc13 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:17.881697 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-6f00a749-a5a5-4d65-9b71-60daa80ddc13 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: d9db33c9-c45f-4643-ad2c-9da35f7ddd07] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:17.888297 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6f00a749-a5a5-4d65-9b71-60daa80ddc13 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:17.889065 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6f00a749-a5a5-4d65-9b71-60daa80ddc13 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:17.890137 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6f00a749-a5a5-4d65-9b71-60daa80ddc13 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:17.890940 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6f00a749-a5a5-4d65-9b71-60daa80ddc13 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:17.912649 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-3d610dd9-ae2e-48a4-a9c7-76e26be0f8d7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:17.925219 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-3d610dd9-ae2e-48a4-a9c7-76e26be0f8d7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:17.926080 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-3d610dd9-ae2e-48a4-a9c7-76e26be0f8d7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:17.927114 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-6f00a749-a5a5-4d65-9b71-60daa80ddc13 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051423 Jan 24 09:20:17.927328 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-3d610dd9-ae2e-48a4-a9c7-76e26be0f8d7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1727 microversion: 2.20 time: 0.172556 Jan 24 09:20:17.927896 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 266/533] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:20:17 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:20:17.928696 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 268/534] 10.222.0.113 () {58 vars in 1306 bytes} [Mon Jan 24 09:20:17 2022] GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 09:20:18.509804 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-fe6e538e-68da-4739-b977-0592151375e7 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:18.510494 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-fe6e538e-68da-4739-b977-0592151375e7 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:18.516847 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-fe6e538e-68da-4739-b977-0592151375e7 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:18.517294 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-fe6e538e-68da-4739-b977-0592151375e7 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:18.518087 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-fe6e538e-68da-4739-b977-0592151375e7 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:18.518587 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-fe6e538e-68da-4739-b977-0592151375e7 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:18.650932 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-fe6e538e-68da-4739-b977-0592151375e7 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:18.658882 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-fe6e538e-68da-4739-b977-0592151375e7 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1726 microversion: 2.1 time: 0.152681 Jan 24 09:20:18.659503 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 269/535] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:18 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:18.940270 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-0f1b5b29-2810-4c8b-af35-d786c1f730b9 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:18.943043 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-0f1b5b29-2810-4c8b-af35-d786c1f730b9 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: d9db33c9-c45f-4643-ad2c-9da35f7ddd07] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:18.952744 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-bbf1e9ab-8103-4369-b428-6d5dd02664c8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:18.953353 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-bbf1e9ab-8103-4369-b428-6d5dd02664c8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:18.958288 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0f1b5b29-2810-4c8b-af35-d786c1f730b9 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:18.958778 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0f1b5b29-2810-4c8b-af35-d786c1f730b9 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:18.959581 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0f1b5b29-2810-4c8b-af35-d786c1f730b9 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:18.960020 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0f1b5b29-2810-4c8b-af35-d786c1f730b9 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:18.960768 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bbf1e9ab-8103-4369-b428-6d5dd02664c8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:18.961218 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bbf1e9ab-8103-4369-b428-6d5dd02664c8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:18.962000 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bbf1e9ab-8103-4369-b428-6d5dd02664c8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:18.962565 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bbf1e9ab-8103-4369-b428-6d5dd02664c8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:19.003878 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-0f1b5b29-2810-4c8b-af35-d786c1f730b9 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068131 Jan 24 09:20:19.004713 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 267/536] 10.222.0.113 () {58 vars in 1306 bytes} [Mon Jan 24 09:20:18 2022] GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:20:19.095773 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-bbf1e9ab-8103-4369-b428-6d5dd02664c8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:19.105204 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-bbf1e9ab-8103-4369-b428-6d5dd02664c8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:19.106657 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-bbf1e9ab-8103-4369-b428-6d5dd02664c8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:19.107813 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-bbf1e9ab-8103-4369-b428-6d5dd02664c8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1727 microversion: 2.20 time: 0.160815 Jan 24 09:20:19.108369 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 270/537] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:20:18 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:20:19.677459 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-5554ceb5-45b6-4009-9e52-4130ac57f38e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:19.678290 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-5554ceb5-45b6-4009-9e52-4130ac57f38e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:19.685845 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5554ceb5-45b6-4009-9e52-4130ac57f38e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:19.686367 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5554ceb5-45b6-4009-9e52-4130ac57f38e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:19.687159 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5554ceb5-45b6-4009-9e52-4130ac57f38e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:19.687601 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5554ceb5-45b6-4009-9e52-4130ac57f38e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:19.827457 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-5554ceb5-45b6-4009-9e52-4130ac57f38e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:19.835442 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-5554ceb5-45b6-4009-9e52-4130ac57f38e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1726 microversion: 2.1 time: 0.162810 Jan 24 09:20:19.836012 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 268/538] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:19 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:20.015754 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-4ef0f1aa-d797-40ef-85a3-145c46fccd79 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:20.016702 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-4ef0f1aa-d797-40ef-85a3-145c46fccd79 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: d9db33c9-c45f-4643-ad2c-9da35f7ddd07] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:20.025227 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4ef0f1aa-d797-40ef-85a3-145c46fccd79 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:20.025719 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4ef0f1aa-d797-40ef-85a3-145c46fccd79 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:20.026911 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4ef0f1aa-d797-40ef-85a3-145c46fccd79 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:20.027451 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4ef0f1aa-d797-40ef-85a3-145c46fccd79 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:20.060420 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-4ef0f1aa-d797-40ef-85a3-145c46fccd79 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048785 Jan 24 09:20:20.061004 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 271/539] 10.222.0.113 () {58 vars in 1306 bytes} [Mon Jan 24 09:20:20 2022] GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:20:20.125353 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-a13da765-6033-4ff7-a1c1-84ed52772432 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:20.126081 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-a13da765-6033-4ff7-a1c1-84ed52772432 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:20.133224 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a13da765-6033-4ff7-a1c1-84ed52772432 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:20.133745 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a13da765-6033-4ff7-a1c1-84ed52772432 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:20.134675 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a13da765-6033-4ff7-a1c1-84ed52772432 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:20.135175 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a13da765-6033-4ff7-a1c1-84ed52772432 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:20.270318 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-a13da765-6033-4ff7-a1c1-84ed52772432 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:20.278169 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-a13da765-6033-4ff7-a1c1-84ed52772432 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:20.279667 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-a13da765-6033-4ff7-a1c1-84ed52772432 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:20.280809 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-a13da765-6033-4ff7-a1c1-84ed52772432 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1727 microversion: 2.20 time: 0.159242 Jan 24 09:20:20.281367 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 269/540] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:20:20 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:20:20.853005 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-364ba3e6-81e7-4dc2-b133-9a16b2a8b74d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:20.853621 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-364ba3e6-81e7-4dc2-b133-9a16b2a8b74d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:20.859382 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-364ba3e6-81e7-4dc2-b133-9a16b2a8b74d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:20.859848 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-364ba3e6-81e7-4dc2-b133-9a16b2a8b74d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:20.860636 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-364ba3e6-81e7-4dc2-b133-9a16b2a8b74d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:20.861066 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-364ba3e6-81e7-4dc2-b133-9a16b2a8b74d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:20.998042 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-364ba3e6-81e7-4dc2-b133-9a16b2a8b74d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:21.006547 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-364ba3e6-81e7-4dc2-b133-9a16b2a8b74d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1726 microversion: 2.1 time: 0.157394 Jan 24 09:20:21.007124 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 272/541] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:20 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:21.081108 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-c521dd12-467f-4d79-8930-9376583352ea tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:21.081108 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-c521dd12-467f-4d79-8930-9376583352ea tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: d9db33c9-c45f-4643-ad2c-9da35f7ddd07] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:21.086925 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c521dd12-467f-4d79-8930-9376583352ea tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:21.088040 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c521dd12-467f-4d79-8930-9376583352ea tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:21.089088 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c521dd12-467f-4d79-8930-9376583352ea tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:21.089587 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c521dd12-467f-4d79-8930-9376583352ea tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:21.126640 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-c521dd12-467f-4d79-8930-9376583352ea tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053641 Jan 24 09:20:21.129686 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 270/542] 10.222.0.113 () {58 vars in 1306 bytes} [Mon Jan 24 09:20:21 2022] GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:20:21.299062 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-97c9fc42-4368-4489-9ea4-0a7700770d0d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:21.299673 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-97c9fc42-4368-4489-9ea4-0a7700770d0d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:21.306797 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-97c9fc42-4368-4489-9ea4-0a7700770d0d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:21.307256 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-97c9fc42-4368-4489-9ea4-0a7700770d0d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:21.308039 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-97c9fc42-4368-4489-9ea4-0a7700770d0d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:21.308474 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-97c9fc42-4368-4489-9ea4-0a7700770d0d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:21.448840 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-97c9fc42-4368-4489-9ea4-0a7700770d0d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:21.457238 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-97c9fc42-4368-4489-9ea4-0a7700770d0d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:21.458767 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-97c9fc42-4368-4489-9ea4-0a7700770d0d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:21.459950 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-97c9fc42-4368-4489-9ea4-0a7700770d0d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1748 microversion: 2.20 time: 0.164768 Jan 24 09:20:21.460520 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 273/543] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:20:21 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1748 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:20:22.023732 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-7dd9e2c9-0cfe-47e9-ac01-b6a8f73a9b75 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:22.024247 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-7dd9e2c9-0cfe-47e9-ac01-b6a8f73a9b75 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:22.030638 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-7dd9e2c9-0cfe-47e9-ac01-b6a8f73a9b75 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:22.031080 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-7dd9e2c9-0cfe-47e9-ac01-b6a8f73a9b75 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:22.031848 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-7dd9e2c9-0cfe-47e9-ac01-b6a8f73a9b75 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:22.032278 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-7dd9e2c9-0cfe-47e9-ac01-b6a8f73a9b75 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:22.139436 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-f15378f3-5a6f-423a-b8a2-5c580a16c814 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:22.140434 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-f15378f3-5a6f-423a-b8a2-5c580a16c814 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: d9db33c9-c45f-4643-ad2c-9da35f7ddd07] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:22.151062 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f15378f3-5a6f-423a-b8a2-5c580a16c814 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:22.151514 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f15378f3-5a6f-423a-b8a2-5c580a16c814 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:22.152308 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f15378f3-5a6f-423a-b8a2-5c580a16c814 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:22.152745 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f15378f3-5a6f-423a-b8a2-5c580a16c814 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:22.188453 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-7dd9e2c9-0cfe-47e9-ac01-b6a8f73a9b75 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:22.195647 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-f15378f3-5a6f-423a-b8a2-5c580a16c814 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060461 Jan 24 09:20:22.196863 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 274/544] 10.222.0.113 () {58 vars in 1306 bytes} [Mon Jan 24 09:20:22 2022] GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 09:20:22.197694 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-7dd9e2c9-0cfe-47e9-ac01-b6a8f73a9b75 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1726 microversion: 2.1 time: 0.178591 Jan 24 09:20:22.198300 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 271/545] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:22 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1726 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:22.479870 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-3522a384-3b32-43e4-80cf-b337f949b1c3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:22.480548 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-3522a384-3b32-43e4-80cf-b337f949b1c3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:22.486805 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3522a384-3b32-43e4-80cf-b337f949b1c3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:22.487263 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3522a384-3b32-43e4-80cf-b337f949b1c3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:22.488821 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3522a384-3b32-43e4-80cf-b337f949b1c3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:22.489271 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3522a384-3b32-43e4-80cf-b337f949b1c3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:22.629658 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-3522a384-3b32-43e4-80cf-b337f949b1c3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:22.637650 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-3522a384-3b32-43e4-80cf-b337f949b1c3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:22.641853 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-3522a384-3b32-43e4-80cf-b337f949b1c3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:22.641853 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-3522a384-3b32-43e4-80cf-b337f949b1c3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1748 microversion: 2.20 time: 0.164999 Jan 24 09:20:22.641853 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 275/546] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:20:22 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1748 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:20:23.208301 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-9279d8ef-50bb-46a8-ba2d-005924ab36c8 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:23.209215 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-9279d8ef-50bb-46a8-ba2d-005924ab36c8 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: d9db33c9-c45f-4643-ad2c-9da35f7ddd07] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:23.215515 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-9279d8ef-50bb-46a8-ba2d-005924ab36c8 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:23.215962 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-9279d8ef-50bb-46a8-ba2d-005924ab36c8 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:23.216741 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-9279d8ef-50bb-46a8-ba2d-005924ab36c8 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:23.217168 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-9279d8ef-50bb-46a8-ba2d-005924ab36c8 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:23.218392 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-5af9552f-a55a-49d5-a5c3-1915e4962a7f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:23.219070 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-5af9552f-a55a-49d5-a5c3-1915e4962a7f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:23.225618 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5af9552f-a55a-49d5-a5c3-1915e4962a7f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:23.226161 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5af9552f-a55a-49d5-a5c3-1915e4962a7f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:23.227237 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5af9552f-a55a-49d5-a5c3-1915e4962a7f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:23.227719 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5af9552f-a55a-49d5-a5c3-1915e4962a7f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:23.247292 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-9279d8ef-50bb-46a8-ba2d-005924ab36c8 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043380 Jan 24 09:20:23.247870 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 272/547] 10.222.0.113 () {58 vars in 1306 bytes} [Mon Jan 24 09:20:23 2022] GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:20:23.346715 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-132168f1-4850-49d2-94a5-25c2f231030b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:20:23.348599 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-132168f1-4850-49d2-94a5-25c2f231030b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:23.354966 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-132168f1-4850-49d2-94a5-25c2f231030b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:23.355432 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-132168f1-4850-49d2-94a5-25c2f231030b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:23.356237 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-132168f1-4850-49d2-94a5-25c2f231030b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:23.356674 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-132168f1-4850-49d2-94a5-25c2f231030b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:23.384422 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.objects.instance [None req-132168f1-4850-49d2-94a5-25c2f231030b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lazy-loading 'flavor' on Instance uuid 047cd9d3-84f2-4cb0-a2ff-1439420b4f84 {{(pid=116864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 09:20:23.387813 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-5af9552f-a55a-49d5-a5c3-1915e4962a7f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:23.396823 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-5af9552f-a55a-49d5-a5c3-1915e4962a7f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1726 microversion: 2.1 time: 0.182718 Jan 24 09:20:23.397673 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 276/548] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:23 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1726 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:20:23.660378 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-455e6f75-d62c-47a3-a573-94f6d1af9094 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:23.660378 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-455e6f75-d62c-47a3-a573-94f6d1af9094 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:23.666741 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-455e6f75-d62c-47a3-a573-94f6d1af9094 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:23.667236 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-455e6f75-d62c-47a3-a573-94f6d1af9094 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:23.668012 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-455e6f75-d62c-47a3-a573-94f6d1af9094 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:23.668449 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-455e6f75-d62c-47a3-a573-94f6d1af9094 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:23.698143 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-132168f1-4850-49d2-94a5-25c2f231030b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "POST /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84/action" status: 200 len: 32 microversion: 2.1 time: 0.355399 Jan 24 09:20:23.699074 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 273/549] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:20:23 2022] POST /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84/action => generated 32 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 09:20:23.709490 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-078b01fe-9c73-4995-b37c-2774b9d6bf73 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:23.710208 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-078b01fe-9c73-4995-b37c-2774b9d6bf73 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:23.717949 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-078b01fe-9c73-4995-b37c-2774b9d6bf73 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:23.718526 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-078b01fe-9c73-4995-b37c-2774b9d6bf73 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:23.719438 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-078b01fe-9c73-4995-b37c-2774b9d6bf73 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:23.719851 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-078b01fe-9c73-4995-b37c-2774b9d6bf73 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:23.871464 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-455e6f75-d62c-47a3-a573-94f6d1af9094 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:23.880423 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-455e6f75-d62c-47a3-a573-94f6d1af9094 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:23.881947 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-455e6f75-d62c-47a3-a573-94f6d1af9094 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:23.883154 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-455e6f75-d62c-47a3-a573-94f6d1af9094 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1748 microversion: 2.20 time: 0.227361 Jan 24 09:20:23.883718 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 277/550] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:20:23 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1748 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 09:20:23.921664 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-078b01fe-9c73-4995-b37c-2774b9d6bf73 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:23.930312 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-078b01fe-9c73-4995-b37c-2774b9d6bf73 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1571 microversion: 2.1 time: 0.225773 Jan 24 09:20:23.930892 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 274/551] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:23 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1571 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:20:24.259258 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-87e97a1b-4f09-456b-bd15-a8af64f7553b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:24.260398 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-87e97a1b-4f09-456b-bd15-a8af64f7553b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: d9db33c9-c45f-4643-ad2c-9da35f7ddd07] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:24.267479 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-87e97a1b-4f09-456b-bd15-a8af64f7553b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:24.267925 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-87e97a1b-4f09-456b-bd15-a8af64f7553b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:24.268705 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-87e97a1b-4f09-456b-bd15-a8af64f7553b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:24.269716 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-87e97a1b-4f09-456b-bd15-a8af64f7553b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:24.301763 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-87e97a1b-4f09-456b-bd15-a8af64f7553b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045580 Jan 24 09:20:24.301873 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 278/552] 10.222.0.113 () {58 vars in 1306 bytes} [Mon Jan 24 09:20:24 2022] GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:20:24.362459 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [req-b75c6580-87fe-40ab-a955-9119b943883d req-234f0ab9-ea90-495b-8539-14450dc6bd48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b820c156-179a-4172-a02b-6c88713087f1", "name": "network-vif-plugged", "status": "completed", "tag": "73ec9bcf-7f40-4fd5-9968-de1accae6f03"}]} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:20:24.365459 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:20:24.365459 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: warnings.warn(msg) Jan 24 09:20:24.381843 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-b75c6580-87fe-40ab-a955-9119b943883d req-234f0ab9-ea90-495b-8539-14450dc6bd48 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:24.383471 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-b75c6580-87fe-40ab-a955-9119b943883d req-234f0ab9-ea90-495b-8539-14450dc6bd48 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:24.399161 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.compute.server_external_events [req-b75c6580-87fe-40ab-a955-9119b943883d req-234f0ab9-ea90-495b-8539-14450dc6bd48 service nova] Creating event network-vif-plugged:73ec9bcf-7f40-4fd5-9968-de1accae6f03 for instance b820c156-179a-4172-a02b-6c88713087f1 on hv-cinder-80403 Jan 24 09:20:24.404713 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [req-b75c6580-87fe-40ab-a955-9119b943883d req-234f0ab9-ea90-495b-8539-14450dc6bd48 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046930 Jan 24 09:20:24.405315 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 275/553] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:20:24.414492 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-9fe5a96d-8a93-400b-ad11-d1def57d3ccb tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:24.415963 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-9fe5a96d-8a93-400b-ad11-d1def57d3ccb tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:24.425124 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9fe5a96d-8a93-400b-ad11-d1def57d3ccb tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:24.426436 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9fe5a96d-8a93-400b-ad11-d1def57d3ccb tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:24.427726 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9fe5a96d-8a93-400b-ad11-d1def57d3ccb tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:24.429081 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9fe5a96d-8a93-400b-ad11-d1def57d3ccb tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:24.621233 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-9fe5a96d-8a93-400b-ad11-d1def57d3ccb tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:24.630782 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-9fe5a96d-8a93-400b-ad11-d1def57d3ccb tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1726 microversion: 2.1 time: 0.219437 Jan 24 09:20:24.631859 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 279/554] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:24 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1726 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:24.902849 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-d9f2adb2-b16b-40df-9d5a-8be03416df3e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:24.917354 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-d9f2adb2-b16b-40df-9d5a-8be03416df3e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:24.918951 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d9f2adb2-b16b-40df-9d5a-8be03416df3e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:24.919510 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d9f2adb2-b16b-40df-9d5a-8be03416df3e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:24.921849 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d9f2adb2-b16b-40df-9d5a-8be03416df3e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:24.922529 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d9f2adb2-b16b-40df-9d5a-8be03416df3e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:24.948255 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-5d173149-2e38-45d1-b50e-fd68860eed29 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:24.948255 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-5d173149-2e38-45d1-b50e-fd68860eed29 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:24.958170 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5d173149-2e38-45d1-b50e-fd68860eed29 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:24.962585 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5d173149-2e38-45d1-b50e-fd68860eed29 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:24.964281 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5d173149-2e38-45d1-b50e-fd68860eed29 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:24.965234 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5d173149-2e38-45d1-b50e-fd68860eed29 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:25.075088 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-d9f2adb2-b16b-40df-9d5a-8be03416df3e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:25.085124 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-d9f2adb2-b16b-40df-9d5a-8be03416df3e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:25.095324 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-d9f2adb2-b16b-40df-9d5a-8be03416df3e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:25.095324 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-d9f2adb2-b16b-40df-9d5a-8be03416df3e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1743 microversion: 2.20 time: 0.189965 Jan 24 09:20:25.100661 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 276/555] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:20:24 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1743 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:20:25.186666 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-5d173149-2e38-45d1-b50e-fd68860eed29 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:25.197040 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-5d173149-2e38-45d1-b50e-fd68860eed29 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1571 microversion: 2.1 time: 0.252889 Jan 24 09:20:25.198132 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 280/556] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:24 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1571 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:25.312853 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-eadbb762-1b45-4b60-ab35-08c17b9d17cb tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:25.313871 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-eadbb762-1b45-4b60-ab35-08c17b9d17cb tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: d9db33c9-c45f-4643-ad2c-9da35f7ddd07] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:25.320839 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-eadbb762-1b45-4b60-ab35-08c17b9d17cb tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:25.321535 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-eadbb762-1b45-4b60-ab35-08c17b9d17cb tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:25.322418 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-eadbb762-1b45-4b60-ab35-08c17b9d17cb tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:25.323073 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-eadbb762-1b45-4b60-ab35-08c17b9d17cb tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:25.356430 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-eadbb762-1b45-4b60-ab35-08c17b9d17cb tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047533 Jan 24 09:20:25.357004 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 277/557] 10.222.0.113 () {58 vars in 1306 bytes} [Mon Jan 24 09:20:25 2022] GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 09:20:25.648987 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-c568baea-5d7b-43b6-9deb-f1d6b296607e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:25.649726 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-c568baea-5d7b-43b6-9deb-f1d6b296607e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:25.656631 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c568baea-5d7b-43b6-9deb-f1d6b296607e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:25.657265 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c568baea-5d7b-43b6-9deb-f1d6b296607e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:25.658287 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c568baea-5d7b-43b6-9deb-f1d6b296607e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:25.658916 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c568baea-5d7b-43b6-9deb-f1d6b296607e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:25.815994 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-c568baea-5d7b-43b6-9deb-f1d6b296607e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:25.824088 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-c568baea-5d7b-43b6-9deb-f1d6b296607e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1726 microversion: 2.1 time: 0.180515 Jan 24 09:20:25.824663 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 281/558] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:25 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1726 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:26.107335 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-8308a083-25eb-4dbd-8e64-772792f3cec8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:26.108844 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-8308a083-25eb-4dbd-8e64-772792f3cec8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:26.117588 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-8308a083-25eb-4dbd-8e64-772792f3cec8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:26.120640 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-8308a083-25eb-4dbd-8e64-772792f3cec8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:26.120640 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-8308a083-25eb-4dbd-8e64-772792f3cec8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:26.120640 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-8308a083-25eb-4dbd-8e64-772792f3cec8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:26.215352 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-f06727da-4fc6-4ee1-88e9-5127d89b502c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:26.216242 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-f06727da-4fc6-4ee1-88e9-5127d89b502c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:26.228279 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f06727da-4fc6-4ee1-88e9-5127d89b502c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:26.228990 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f06727da-4fc6-4ee1-88e9-5127d89b502c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:26.230207 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f06727da-4fc6-4ee1-88e9-5127d89b502c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:26.230888 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f06727da-4fc6-4ee1-88e9-5127d89b502c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:26.365671 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-8308a083-25eb-4dbd-8e64-772792f3cec8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:26.374776 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-8308a083-25eb-4dbd-8e64-772792f3cec8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:26.376785 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-8308a083-25eb-4dbd-8e64-772792f3cec8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:26.379132 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-8308a083-25eb-4dbd-8e64-772792f3cec8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1743 microversion: 2.20 time: 0.275442 Jan 24 09:20:26.382618 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 278/559] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:20:26 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1743 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:20:26.407445 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-f06727da-4fc6-4ee1-88e9-5127d89b502c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:26.416517 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-f06727da-4fc6-4ee1-88e9-5127d89b502c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1571 microversion: 2.1 time: 0.205271 Jan 24 09:20:26.417352 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 282/560] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:26 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1571 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:20:26.847796 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-17d5133c-7876-42f1-97d6-1c2116c9b5de tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:26.851065 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-17d5133c-7876-42f1-97d6-1c2116c9b5de tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:26.860377 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-17d5133c-7876-42f1-97d6-1c2116c9b5de tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:26.861486 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-17d5133c-7876-42f1-97d6-1c2116c9b5de tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:26.862859 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-17d5133c-7876-42f1-97d6-1c2116c9b5de tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:26.863913 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-17d5133c-7876-42f1-97d6-1c2116c9b5de tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:27.084858 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-17d5133c-7876-42f1-97d6-1c2116c9b5de tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:27.095403 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-17d5133c-7876-42f1-97d6-1c2116c9b5de tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1726 microversion: 2.1 time: 0.255575 Jan 24 09:20:27.109164 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 279/561] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:26 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1726 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:27.399875 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-cd9362d1-13ef-4492-b934-aaaeec6d50ef tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:27.401958 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-cd9362d1-13ef-4492-b934-aaaeec6d50ef tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:27.412728 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-cd9362d1-13ef-4492-b934-aaaeec6d50ef tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:27.413329 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-cd9362d1-13ef-4492-b934-aaaeec6d50ef tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:27.414759 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-cd9362d1-13ef-4492-b934-aaaeec6d50ef tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:27.415231 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-cd9362d1-13ef-4492-b934-aaaeec6d50ef tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:27.446004 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-6d9ea9fd-9bbe-4594-817e-3db0cec17c57 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:27.446742 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-6d9ea9fd-9bbe-4594-817e-3db0cec17c57 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:27.454532 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6d9ea9fd-9bbe-4594-817e-3db0cec17c57 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:27.455158 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6d9ea9fd-9bbe-4594-817e-3db0cec17c57 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:27.456034 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6d9ea9fd-9bbe-4594-817e-3db0cec17c57 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:27.456597 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6d9ea9fd-9bbe-4594-817e-3db0cec17c57 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:27.669379 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-cd9362d1-13ef-4492-b934-aaaeec6d50ef tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:27.671607 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-6d9ea9fd-9bbe-4594-817e-3db0cec17c57 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:27.684535 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-6d9ea9fd-9bbe-4594-817e-3db0cec17c57 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1571 microversion: 2.1 time: 0.252739 Jan 24 09:20:27.685054 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-cd9362d1-13ef-4492-b934-aaaeec6d50ef tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:27.692869 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 280/562] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:27 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1571 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:27.695497 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-cd9362d1-13ef-4492-b934-aaaeec6d50ef tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:27.705207 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-cd9362d1-13ef-4492-b934-aaaeec6d50ef tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1743 microversion: 2.20 time: 0.306473 Jan 24 09:20:27.708032 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 283/563] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:20:27 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1743 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:20:27.772849 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-a3f0f28b-afd5-4fab-8c46-af850b2c4f74 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:27.776660 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-a3f0f28b-afd5-4fab-8c46-af850b2c4f74 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: d9db33c9-c45f-4643-ad2c-9da35f7ddd07] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:27.787321 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a3f0f28b-afd5-4fab-8c46-af850b2c4f74 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:27.788411 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a3f0f28b-afd5-4fab-8c46-af850b2c4f74 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:27.790067 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a3f0f28b-afd5-4fab-8c46-af850b2c4f74 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:27.791069 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a3f0f28b-afd5-4fab-8c46-af850b2c4f74 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:27.851596 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-a3f0f28b-afd5-4fab-8c46-af850b2c4f74 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: d9db33c9-c45f-4643-ad2c-9da35f7ddd07] Going to try to terminate instance {{(pid=116864) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 09:20:28.113286 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-5526b00b-a674-4b57-b654-87e7c7c86780 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:28.114334 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-5526b00b-a674-4b57-b654-87e7c7c86780 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:28.131775 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5526b00b-a674-4b57-b654-87e7c7c86780 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:28.134263 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5526b00b-a674-4b57-b654-87e7c7c86780 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:28.134263 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5526b00b-a674-4b57-b654-87e7c7c86780 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:28.134861 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5526b00b-a674-4b57-b654-87e7c7c86780 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:28.372932 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-a3f0f28b-afd5-4fab-8c46-af850b2c4f74 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "DELETE /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07" status: 204 len: 0 microversion: 2.1 time: 0.606170 Jan 24 09:20:28.385523 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 281/564] 10.222.0.113 () {58 vars in 1243 bytes} [Mon Jan 24 09:20:27 2022] DELETE /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 24 09:20:28.385523 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-40a60a7e-0e89-40ae-9b73-7f36e34528d2 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1923537236", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-760537949", "security_groups": [{"name": "tempest-secgroup-smoke-1899158498"}], "block_device_mapping_v2": [{"uuid": "a55500f8-0737-4565-bea5-3ba78687a8ea", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "bb18b00a-6e74-4475-8741-4c8ca85a032a"}]}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:20:28.430419 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-5526b00b-a674-4b57-b654-87e7c7c86780 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:28.447856 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-5526b00b-a674-4b57-b654-87e7c7c86780 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1726 microversion: 2.1 time: 0.331324 Jan 24 09:20:28.447856 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 284/565] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:28 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1726 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:28.459687 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-1ac6a6f0-8f3f-4605-b9a4-bd1c518569ec tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:28.474598 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-1ac6a6f0-8f3f-4605-b9a4-bd1c518569ec tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: d9db33c9-c45f-4643-ad2c-9da35f7ddd07] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:28.474598 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1ac6a6f0-8f3f-4605-b9a4-bd1c518569ec tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:28.474598 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1ac6a6f0-8f3f-4605-b9a4-bd1c518569ec tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:28.474598 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1ac6a6f0-8f3f-4605-b9a4-bd1c518569ec tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:28.475193 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1ac6a6f0-8f3f-4605-b9a4-bd1c518569ec tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:28.569010 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.network.neutron [None req-40a60a7e-0e89-40ae-9b73-7f36e34528d2 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] validate_networks() for [('bb18b00a-6e74-4475-8741-4c8ca85a032a', None, None, None, None, None)] {{(pid=116864) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 09:20:28.690560 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-1ac6a6f0-8f3f-4605-b9a4-bd1c518569ec tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:28.702266 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-1ac6a6f0-8f3f-4605-b9a4-bd1c518569ec tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07" status: 200 len: 1518 microversion: 2.1 time: 0.256295 Jan 24 09:20:28.702266 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 285/566] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:28 2022] GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07 => generated 1518 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:28.712352 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-168b0d84-0840-448a-aa62-092c727aad81 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:28.713276 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-168b0d84-0840-448a-aa62-092c727aad81 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:28.719200 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-168b0d84-0840-448a-aa62-092c727aad81 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:28.719812 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-168b0d84-0840-448a-aa62-092c727aad81 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:28.720605 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-168b0d84-0840-448a-aa62-092c727aad81 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:28.721364 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-168b0d84-0840-448a-aa62-092c727aad81 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:28.874679 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-168b0d84-0840-448a-aa62-092c727aad81 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:28.884196 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-168b0d84-0840-448a-aa62-092c727aad81 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1571 microversion: 2.1 time: 0.175481 Jan 24 09:20:28.884791 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 286/567] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:28 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1571 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:28.889642 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-dca92066-debd-492b-82f7-85527b0552d1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:28.891043 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-dca92066-debd-492b-82f7-85527b0552d1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:28.900860 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-dca92066-debd-492b-82f7-85527b0552d1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:28.902944 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-dca92066-debd-492b-82f7-85527b0552d1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:28.904348 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-dca92066-debd-492b-82f7-85527b0552d1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:28.905092 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-dca92066-debd-492b-82f7-85527b0552d1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:29.047890 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-dca92066-debd-492b-82f7-85527b0552d1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:29.057308 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-dca92066-debd-492b-82f7-85527b0552d1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:29.058833 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-dca92066-debd-492b-82f7-85527b0552d1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:29.059989 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-dca92066-debd-492b-82f7-85527b0552d1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1743 microversion: 2.20 time: 0.174291 Jan 24 09:20:29.060586 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 287/568] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:20:28 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1743 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:20:29.068211 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-40a60a7e-0e89-40ae-9b73-7f36e34528d2 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Flavor limits 0:0:0 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 09:20:29.068630 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-40a60a7e-0e89-40ae-9b73-7f36e34528d2 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Image limits 0:0:0 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 09:20:29.069103 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-40a60a7e-0e89-40ae-9b73-7f36e34528d2 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Flavor pref 0:0:0 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 09:20:29.069536 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-40a60a7e-0e89-40ae-9b73-7f36e34528d2 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Image pref 0:0:0 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 09:20:29.069946 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-40a60a7e-0e89-40ae-9b73-7f36e34528d2 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 09:20:29.078577 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-40a60a7e-0e89-40ae-9b73-7f36e34528d2 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:29.079022 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-40a60a7e-0e89-40ae-9b73-7f36e34528d2 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:29.079831 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-40a60a7e-0e89-40ae-9b73-7f36e34528d2 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:29.080265 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-40a60a7e-0e89-40ae-9b73-7f36e34528d2 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:29.097607 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.quota [None req-40a60a7e-0e89-40ae-9b73-7f36e34528d2 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Getting quotas for project bedaa9b436ab45108aa33633b17e58d0. Resources: {'ram', 'cores', 'instances'} {{(pid=116864) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 09:20:29.101675 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.quota [None req-40a60a7e-0e89-40ae-9b73-7f36e34528d2 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Getting quotas for user 91399ccc8ba64dc7becff56785e9b904 and project bedaa9b436ab45108aa33633b17e58d0. Resources: {'ram', 'cores', 'instances'} {{(pid=116864) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 09:20:29.165380 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-40a60a7e-0e89-40ae-9b73-7f36e34528d2 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Going to run 1 instances... {{(pid=116864) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 09:20:29.165984 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-40a60a7e-0e89-40ae-9b73-7f36e34528d2 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f31eba5c-d268-48b8-8d66-c1da93154cc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a55500f8-0737-4565-bea5-3ba78687a8ea',volume_size=None,volume_type=None)] {{(pid=116864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 09:20:29.463041 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-5b0c20e3-b456-4489-b0c5-347b44387b3a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:29.464463 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-5b0c20e3-b456-4489-b0c5-347b44387b3a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:29.472761 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5b0c20e3-b456-4489-b0c5-347b44387b3a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:29.473509 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5b0c20e3-b456-4489-b0c5-347b44387b3a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:29.474550 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5b0c20e3-b456-4489-b0c5-347b44387b3a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:29.475187 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5b0c20e3-b456-4489-b0c5-347b44387b3a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:29.678063 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-5b0c20e3-b456-4489-b0c5-347b44387b3a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:29.686546 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-5b0c20e3-b456-4489-b0c5-347b44387b3a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1726 microversion: 2.1 time: 0.230038 Jan 24 09:20:29.688492 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 288/569] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:29 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1726 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:20:29.720987 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-bc90eb53-4ea8-4709-b404-57b383713c2b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:29.721410 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-bc90eb53-4ea8-4709-b404-57b383713c2b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: d9db33c9-c45f-4643-ad2c-9da35f7ddd07] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:29.728275 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bc90eb53-4ea8-4709-b404-57b383713c2b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:29.728759 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bc90eb53-4ea8-4709-b404-57b383713c2b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:29.729553 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bc90eb53-4ea8-4709-b404-57b383713c2b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:29.729988 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bc90eb53-4ea8-4709-b404-57b383713c2b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:29.750685 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-40a60a7e-0e89-40ae-9b73-7f36e34528d2 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.375814 Jan 24 09:20:29.753575 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 282/570] 10.222.0.113 () {60 vars in 1151 bytes} [Mon Jan 24 09:20:28 2022] POST /compute/v2.1/servers => generated 408 bytes in 1379 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 24 09:20:29.774342 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-4a42e461-3981-44a3-b3b8-631d4c48e326 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:29.808369 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-4a42e461-3981-44a3-b3b8-631d4c48e326 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f31eba5c-d268-48b8-8d66-c1da93154cc4] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:29.954370 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-4a42e461-3981-44a3-b3b8-631d4c48e326 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:29.954613 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-bc90eb53-4ea8-4709-b404-57b383713c2b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:29.962972 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-4a42e461-3981-44a3-b3b8-631d4c48e326 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4" status: 200 len: 1097 microversion: 2.1 time: 0.198509 Jan 24 09:20:29.964025 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-bc90eb53-4ea8-4709-b404-57b383713c2b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07" status: 200 len: 1518 microversion: 2.1 time: 0.250737 Jan 24 09:20:29.965532 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 283/571] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:29 2022] GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4 => generated 1097 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:29.970359 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-44293f1e-7003-4e6b-ba27-5339440fc5c8 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:29.971201 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-44293f1e-7003-4e6b-ba27-5339440fc5c8 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:29.973162 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 289/572] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:29 2022] GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07 => generated 1518 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:20:29.978759 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-44293f1e-7003-4e6b-ba27-5339440fc5c8 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:29.979245 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-44293f1e-7003-4e6b-ba27-5339440fc5c8 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:29.980056 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-44293f1e-7003-4e6b-ba27-5339440fc5c8 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:29.980495 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-44293f1e-7003-4e6b-ba27-5339440fc5c8 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:30.078978 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-f326d17d-70c8-4d3b-8ecf-96f0e6abe4dc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:30.079836 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-f326d17d-70c8-4d3b-8ecf-96f0e6abe4dc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:30.089391 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f326d17d-70c8-4d3b-8ecf-96f0e6abe4dc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:30.090074 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f326d17d-70c8-4d3b-8ecf-96f0e6abe4dc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:30.093314 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f326d17d-70c8-4d3b-8ecf-96f0e6abe4dc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:30.093881 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f326d17d-70c8-4d3b-8ecf-96f0e6abe4dc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:30.139337 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-44293f1e-7003-4e6b-ba27-5339440fc5c8 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:30.150388 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-44293f1e-7003-4e6b-ba27-5339440fc5c8 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1571 microversion: 2.1 time: 0.183446 Jan 24 09:20:30.161285 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 284/573] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:29 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1571 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:30.266438 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-f326d17d-70c8-4d3b-8ecf-96f0e6abe4dc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:30.276045 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-f326d17d-70c8-4d3b-8ecf-96f0e6abe4dc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:30.277547 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-f326d17d-70c8-4d3b-8ecf-96f0e6abe4dc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:30.278760 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-f326d17d-70c8-4d3b-8ecf-96f0e6abe4dc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1743 microversion: 2.20 time: 0.204349 Jan 24 09:20:30.294005 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 290/574] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:20:30 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1743 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 09:20:30.709392 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-5d5a1736-702f-42a9-acb5-1590cb515ec1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:30.710349 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-5d5a1736-702f-42a9-acb5-1590cb515ec1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:30.725078 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5d5a1736-702f-42a9-acb5-1590cb515ec1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:30.725824 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5d5a1736-702f-42a9-acb5-1590cb515ec1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:30.728505 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5d5a1736-702f-42a9-acb5-1590cb515ec1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:30.729158 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5d5a1736-702f-42a9-acb5-1590cb515ec1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:30.919176 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-5d5a1736-702f-42a9-acb5-1590cb515ec1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:30.933358 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-5d5a1736-702f-42a9-acb5-1590cb515ec1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1726 microversion: 2.1 time: 0.229415 Jan 24 09:20:30.945554 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 285/575] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:30 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1726 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:30.984578 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-fdd16493-019d-41c8-9683-e68dbe416c9c tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:30.985187 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-fdd16493-019d-41c8-9683-e68dbe416c9c tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f31eba5c-d268-48b8-8d66-c1da93154cc4] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:30.988703 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-dba62ff8-9a02-4bcb-9744-8989c8aa55c1 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:30.990370 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-dba62ff8-9a02-4bcb-9744-8989c8aa55c1 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: d9db33c9-c45f-4643-ad2c-9da35f7ddd07] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:30.998998 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-dba62ff8-9a02-4bcb-9744-8989c8aa55c1 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:30.999934 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-dba62ff8-9a02-4bcb-9744-8989c8aa55c1 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:31.001114 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-dba62ff8-9a02-4bcb-9744-8989c8aa55c1 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:31.001768 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-dba62ff8-9a02-4bcb-9744-8989c8aa55c1 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:31.083626 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-fdd16493-019d-41c8-9683-e68dbe416c9c tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:31.096323 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-fdd16493-019d-41c8-9683-e68dbe416c9c tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4" status: 200 len: 1097 microversion: 2.1 time: 0.115178 Jan 24 09:20:31.107630 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 286/576] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:30 2022] GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4 => generated 1097 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:31.171216 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-15e31ac1-2b51-41e5-b6ca-37914911961b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:31.172113 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-15e31ac1-2b51-41e5-b6ca-37914911961b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:31.188337 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-15e31ac1-2b51-41e5-b6ca-37914911961b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:31.193446 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-15e31ac1-2b51-41e5-b6ca-37914911961b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:31.194964 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-15e31ac1-2b51-41e5-b6ca-37914911961b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:31.195745 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-15e31ac1-2b51-41e5-b6ca-37914911961b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:31.213978 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-dba62ff8-9a02-4bcb-9744-8989c8aa55c1 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:31.223191 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-dba62ff8-9a02-4bcb-9744-8989c8aa55c1 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07" status: 200 len: 1518 microversion: 2.1 time: 0.245257 Jan 24 09:20:31.232119 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 291/577] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:30 2022] GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07 => generated 1518 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:31.296835 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-abc98162-e48c-4875-82da-3665ad18fe95 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:31.297626 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-abc98162-e48c-4875-82da-3665ad18fe95 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:31.310363 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-abc98162-e48c-4875-82da-3665ad18fe95 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:31.311083 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-abc98162-e48c-4875-82da-3665ad18fe95 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:31.312086 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-abc98162-e48c-4875-82da-3665ad18fe95 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:31.312687 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-abc98162-e48c-4875-82da-3665ad18fe95 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:31.431243 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-15e31ac1-2b51-41e5-b6ca-37914911961b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:31.459326 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-15e31ac1-2b51-41e5-b6ca-37914911961b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1571 microversion: 2.1 time: 0.292882 Jan 24 09:20:31.460491 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 287/578] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:31 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1571 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:20:31.622334 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-abc98162-e48c-4875-82da-3665ad18fe95 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:31.637972 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-abc98162-e48c-4875-82da-3665ad18fe95 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:31.642196 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-abc98162-e48c-4875-82da-3665ad18fe95 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:31.645912 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-abc98162-e48c-4875-82da-3665ad18fe95 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1743 microversion: 2.20 time: 0.351527 Jan 24 09:20:31.646763 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 292/579] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:20:31 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1743 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 09:20:31.952764 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-1b8af417-9090-4fa1-962b-7972334838fa tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:31.953381 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-1b8af417-9090-4fa1-962b-7972334838fa tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:31.962469 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1b8af417-9090-4fa1-962b-7972334838fa tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:31.962916 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1b8af417-9090-4fa1-962b-7972334838fa tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:31.963720 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1b8af417-9090-4fa1-962b-7972334838fa tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:31.964158 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1b8af417-9090-4fa1-962b-7972334838fa tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:32.117239 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-3f15e4e6-a147-4293-9d38-5d3d27bc9374 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:32.118007 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-3f15e4e6-a147-4293-9d38-5d3d27bc9374 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f31eba5c-d268-48b8-8d66-c1da93154cc4] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:32.132954 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3f15e4e6-a147-4293-9d38-5d3d27bc9374 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:32.132954 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3f15e4e6-a147-4293-9d38-5d3d27bc9374 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:32.132954 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3f15e4e6-a147-4293-9d38-5d3d27bc9374 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:32.132954 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3f15e4e6-a147-4293-9d38-5d3d27bc9374 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:32.248873 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-1b8af417-9090-4fa1-962b-7972334838fa tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:32.257812 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-3f15e4e6-a147-4293-9d38-5d3d27bc9374 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:32.267614 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-3f15e4e6-a147-4293-9d38-5d3d27bc9374 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4" status: 200 len: 1139 microversion: 2.1 time: 0.157249 Jan 24 09:20:32.277845 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 293/580] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:32 2022] GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4 => generated 1139 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:20:32.277845 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [req-fda7a2d2-1b38-4d51-8cfb-b165e36c0a20 req-89b7d0c3-4805-48a4-8248-28fb9457cc92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9db33c9-c45f-4643-ad2c-9da35f7ddd07", "name": "network-vif-deleted", "tag": "8f1acf57-8e99-4966-b91e-ff0b6193520a"}]} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:20:32.277845 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:20:32.277845 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: warnings.warn(msg) Jan 24 09:20:32.278339 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-1b8af417-9090-4fa1-962b-7972334838fa tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1726 microversion: 2.1 time: 0.326294 Jan 24 09:20:32.290039 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 288/581] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:31 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1726 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:32.290266 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-fda7a2d2-1b38-4d51-8cfb-b165e36c0a20 req-89b7d0c3-4805-48a4-8248-28fb9457cc92 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:32.290266 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-fda7a2d2-1b38-4d51-8cfb-b165e36c0a20 req-89b7d0c3-4805-48a4-8248-28fb9457cc92 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:32.299754 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.compute.server_external_events [req-fda7a2d2-1b38-4d51-8cfb-b165e36c0a20 req-89b7d0c3-4805-48a4-8248-28fb9457cc92 service nova] Creating event network-vif-deleted:8f1acf57-8e99-4966-b91e-ff0b6193520a for instance d9db33c9-c45f-4643-ad2c-9da35f7ddd07 on hv-cinder-80403 Jan 24 09:20:32.306137 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [req-fda7a2d2-1b38-4d51-8cfb-b165e36c0a20 req-89b7d0c3-4805-48a4-8248-28fb9457cc92 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035376 Jan 24 09:20:32.306888 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 294/582] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:20:32.310830 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-3e41bce2-7ef0-451a-8cc6-226c6edfe3bc tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:32.312701 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-3e41bce2-7ef0-451a-8cc6-226c6edfe3bc tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: d9db33c9-c45f-4643-ad2c-9da35f7ddd07] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:32.331601 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3e41bce2-7ef0-451a-8cc6-226c6edfe3bc tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:32.332725 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3e41bce2-7ef0-451a-8cc6-226c6edfe3bc tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:32.333810 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3e41bce2-7ef0-451a-8cc6-226c6edfe3bc tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:32.334443 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3e41bce2-7ef0-451a-8cc6-226c6edfe3bc tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:32.435307 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-3e41bce2-7ef0-451a-8cc6-226c6edfe3bc tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:32.449617 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-3e41bce2-7ef0-451a-8cc6-226c6edfe3bc tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07" status: 200 len: 1476 microversion: 2.1 time: 0.166718 Jan 24 09:20:32.450424 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 289/583] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:32 2022] GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07 => generated 1476 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:32.478648 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-fb150eba-7028-49f9-bc47-628071624c40 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:32.479343 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-fb150eba-7028-49f9-bc47-628071624c40 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:32.485915 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-fb150eba-7028-49f9-bc47-628071624c40 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:32.486410 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-fb150eba-7028-49f9-bc47-628071624c40 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:32.487382 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-fb150eba-7028-49f9-bc47-628071624c40 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:32.488022 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-fb150eba-7028-49f9-bc47-628071624c40 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:32.655636 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-fb150eba-7028-49f9-bc47-628071624c40 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:32.664616 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-b84dfe8b-bcee-47c3-b6ef-f7eb01174859 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:32.665227 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-b84dfe8b-bcee-47c3-b6ef-f7eb01174859 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:32.666373 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-fb150eba-7028-49f9-bc47-628071624c40 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1571 microversion: 2.1 time: 0.191734 Jan 24 09:20:32.674304 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b84dfe8b-bcee-47c3-b6ef-f7eb01174859 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:32.676054 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b84dfe8b-bcee-47c3-b6ef-f7eb01174859 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:32.677145 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b84dfe8b-bcee-47c3-b6ef-f7eb01174859 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:32.677703 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 295/584] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:32 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1571 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:32.678169 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b84dfe8b-bcee-47c3-b6ef-f7eb01174859 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:32.843226 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-b84dfe8b-bcee-47c3-b6ef-f7eb01174859 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:32.851709 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-b84dfe8b-bcee-47c3-b6ef-f7eb01174859 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:32.853201 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-b84dfe8b-bcee-47c3-b6ef-f7eb01174859 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:32.854387 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-b84dfe8b-bcee-47c3-b6ef-f7eb01174859 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1743 microversion: 2.20 time: 0.193645 Jan 24 09:20:32.854957 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 290/585] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:20:32 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1743 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 09:20:33.286335 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-7bd79b47-9b0f-4d79-a996-8f8500c888aa tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:33.286958 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-7bd79b47-9b0f-4d79-a996-8f8500c888aa tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f31eba5c-d268-48b8-8d66-c1da93154cc4] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:33.294729 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7bd79b47-9b0f-4d79-a996-8f8500c888aa tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:33.295174 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7bd79b47-9b0f-4d79-a996-8f8500c888aa tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:33.295954 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7bd79b47-9b0f-4d79-a996-8f8500c888aa tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:33.296383 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7bd79b47-9b0f-4d79-a996-8f8500c888aa tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:33.300439 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-e008cfab-c0e4-43b2-b0ba-f69ffe6a8926 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:33.302720 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-e008cfab-c0e4-43b2-b0ba-f69ffe6a8926 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:33.308065 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e008cfab-c0e4-43b2-b0ba-f69ffe6a8926 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:33.308514 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e008cfab-c0e4-43b2-b0ba-f69ffe6a8926 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:33.309288 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e008cfab-c0e4-43b2-b0ba-f69ffe6a8926 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:33.309724 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e008cfab-c0e4-43b2-b0ba-f69ffe6a8926 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:33.361646 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-7bd79b47-9b0f-4d79-a996-8f8500c888aa tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:33.369671 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-7bd79b47-9b0f-4d79-a996-8f8500c888aa tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4" status: 200 len: 1195 microversion: 2.1 time: 0.087302 Jan 24 09:20:33.370771 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 296/586] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:33 2022] GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4 => generated 1195 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:20:33.464613 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-e008cfab-c0e4-43b2-b0ba-f69ffe6a8926 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:33.467147 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-cc70df37-e6f6-41cf-ae30-ab514f078234 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:33.467792 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-cc70df37-e6f6-41cf-ae30-ab514f078234 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: d9db33c9-c45f-4643-ad2c-9da35f7ddd07] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:33.475780 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-e008cfab-c0e4-43b2-b0ba-f69ffe6a8926 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1726 microversion: 2.1 time: 0.179260 Jan 24 09:20:33.475999 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-cc70df37-e6f6-41cf-ae30-ab514f078234 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:33.476529 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-cc70df37-e6f6-41cf-ae30-ab514f078234 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:33.477278 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 291/587] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:33 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1726 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:33.477705 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-cc70df37-e6f6-41cf-ae30-ab514f078234 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:33.478168 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-cc70df37-e6f6-41cf-ae30-ab514f078234 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:33.517510 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-cc70df37-e6f6-41cf-ae30-ab514f078234 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:33.518185 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-cc70df37-e6f6-41cf-ae30-ab514f078234 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:33.519319 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.objects.instance [None req-cc70df37-e6f6-41cf-ae30-ab514f078234 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lazy-loading 'fault' on Instance uuid d9db33c9-c45f-4643-ad2c-9da35f7ddd07 {{(pid=116863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 09:20:33.568678 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-cc70df37-e6f6-41cf-ae30-ab514f078234 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:33.577349 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-cc70df37-e6f6-41cf-ae30-ab514f078234 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07" status: 200 len: 1312 microversion: 2.1 time: 0.114417 Jan 24 09:20:33.586809 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 297/588] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:33 2022] GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07 => generated 1312 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:20:33.687550 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-4de27608-b3ce-41f6-afb7-93bc6fb62f1f tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:33.688445 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-4de27608-b3ce-41f6-afb7-93bc6fb62f1f tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:33.698746 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4de27608-b3ce-41f6-afb7-93bc6fb62f1f tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:33.699436 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4de27608-b3ce-41f6-afb7-93bc6fb62f1f tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:33.700858 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4de27608-b3ce-41f6-afb7-93bc6fb62f1f tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:33.701774 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4de27608-b3ce-41f6-afb7-93bc6fb62f1f tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:33.872858 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-3103fc15-6c6f-447d-9a87-189b68157488 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:33.873484 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-3103fc15-6c6f-447d-9a87-189b68157488 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:33.889051 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3103fc15-6c6f-447d-9a87-189b68157488 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:33.890214 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3103fc15-6c6f-447d-9a87-189b68157488 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:33.891196 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3103fc15-6c6f-447d-9a87-189b68157488 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:33.891761 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-4de27608-b3ce-41f6-afb7-93bc6fb62f1f tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:33.898459 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3103fc15-6c6f-447d-9a87-189b68157488 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:33.905740 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-4de27608-b3ce-41f6-afb7-93bc6fb62f1f tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1571 microversion: 2.1 time: 0.223688 Jan 24 09:20:33.906493 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 292/589] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:33 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1571 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:34.079153 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-3103fc15-6c6f-447d-9a87-189b68157488 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:34.092166 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-3103fc15-6c6f-447d-9a87-189b68157488 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:34.098574 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-3103fc15-6c6f-447d-9a87-189b68157488 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:34.098574 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-3103fc15-6c6f-447d-9a87-189b68157488 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1743 microversion: 2.20 time: 0.226322 Jan 24 09:20:34.098574 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 298/590] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:20:33 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1743 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:20:34.398187 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-45fb3279-8361-4b6e-beb8-19412c0cbd93 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:34.400075 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-45fb3279-8361-4b6e-beb8-19412c0cbd93 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f31eba5c-d268-48b8-8d66-c1da93154cc4] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:34.412129 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-45fb3279-8361-4b6e-beb8-19412c0cbd93 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:34.413295 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-45fb3279-8361-4b6e-beb8-19412c0cbd93 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:34.415031 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-45fb3279-8361-4b6e-beb8-19412c0cbd93 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:34.416217 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-45fb3279-8361-4b6e-beb8-19412c0cbd93 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:34.492650 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-cda4afe0-f129-4782-814b-e74b80b53fb6 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:34.493382 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-cda4afe0-f129-4782-814b-e74b80b53fb6 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:34.508299 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-cda4afe0-f129-4782-814b-e74b80b53fb6 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:34.508712 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-cda4afe0-f129-4782-814b-e74b80b53fb6 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:34.509501 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-cda4afe0-f129-4782-814b-e74b80b53fb6 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:34.509939 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-cda4afe0-f129-4782-814b-e74b80b53fb6 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:34.875263 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-cda4afe0-f129-4782-814b-e74b80b53fb6 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:34.888782 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-cda4afe0-f129-4782-814b-e74b80b53fb6 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1726 microversion: 2.1 time: 0.399569 Jan 24 09:20:34.892637 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 299/591] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:34 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1726 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:20:34.897893 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-96e48d09-a570-43e5-8b19-d74bd12ef208 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:34.898549 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-96e48d09-a570-43e5-8b19-d74bd12ef208 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: d9db33c9-c45f-4643-ad2c-9da35f7ddd07] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:34.916471 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-96e48d09-a570-43e5-8b19-d74bd12ef208 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:34.919586 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-96e48d09-a570-43e5-8b19-d74bd12ef208 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:34.920582 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-96e48d09-a570-43e5-8b19-d74bd12ef208 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:34.924046 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-96e48d09-a570-43e5-8b19-d74bd12ef208 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:34.951821 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.wsgi [None req-96e48d09-a570-43e5-8b19-d74bd12ef208 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] HTTP exception thrown: Instance d9db33c9-c45f-4643-ad2c-9da35f7ddd07 could not be found. Jan 24 09:20:34.961608 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-45fb3279-8361-4b6e-beb8-19412c0cbd93 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:34.978311 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-96e48d09-a570-43e5-8b19-d74bd12ef208 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Returning 404 to user: Instance d9db33c9-c45f-4643-ad2c-9da35f7ddd07 could not be found. {{(pid=116863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:20:34.978311 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-96e48d09-a570-43e5-8b19-d74bd12ef208 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07" status: 404 len: 111 microversion: 2.1 time: 0.075823 Jan 24 09:20:34.979681 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-45fb3279-8361-4b6e-beb8-19412c0cbd93 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4" status: 200 len: 1203 microversion: 2.1 time: 0.578108 Jan 24 09:20:34.979784 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 300/592] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:34 2022] GET /compute/v2.1/servers/d9db33c9-c45f-4643-ad2c-9da35f7ddd07 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 09:20:34.982351 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 293/593] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:34 2022] GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4 => generated 1203 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:20:34.994789 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-6f2a6ad8-9906-41d3-b5dd-6edf713c6372 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:34.996904 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-6f2a6ad8-9906-41d3-b5dd-6edf713c6372 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:35.014081 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6f2a6ad8-9906-41d3-b5dd-6edf713c6372 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:35.014955 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6f2a6ad8-9906-41d3-b5dd-6edf713c6372 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:35.016121 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6f2a6ad8-9906-41d3-b5dd-6edf713c6372 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:35.016782 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6f2a6ad8-9906-41d3-b5dd-6edf713c6372 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:35.119056 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-6ccc232e-d016-4075-be6e-a7c011aacbde tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:35.119821 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-6ccc232e-d016-4075-be6e-a7c011aacbde tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:35.141032 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6ccc232e-d016-4075-be6e-a7c011aacbde tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:35.142375 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6ccc232e-d016-4075-be6e-a7c011aacbde tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:35.144237 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6ccc232e-d016-4075-be6e-a7c011aacbde tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:35.146031 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6ccc232e-d016-4075-be6e-a7c011aacbde tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:35.310134 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-6f2a6ad8-9906-41d3-b5dd-6edf713c6372 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:35.329653 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-6f2a6ad8-9906-41d3-b5dd-6edf713c6372 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1571 microversion: 2.1 time: 0.348519 Jan 24 09:20:35.330624 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 301/594] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:34 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1571 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:35.415743 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-6ccc232e-d016-4075-be6e-a7c011aacbde tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:35.426359 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-6ccc232e-d016-4075-be6e-a7c011aacbde tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:35.430066 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-6ccc232e-d016-4075-be6e-a7c011aacbde tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:35.432007 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-6ccc232e-d016-4075-be6e-a7c011aacbde tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1743 microversion: 2.20 time: 0.318427 Jan 24 09:20:35.453138 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 294/595] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:20:35 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1743 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:20:35.907806 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-87320bdc-126d-4769-b3a6-758c0e147315 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:35.908421 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-87320bdc-126d-4769-b3a6-758c0e147315 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:35.934959 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-87320bdc-126d-4769-b3a6-758c0e147315 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:35.935422 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-87320bdc-126d-4769-b3a6-758c0e147315 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:35.936242 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-87320bdc-126d-4769-b3a6-758c0e147315 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:35.936681 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-87320bdc-126d-4769-b3a6-758c0e147315 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:35.991507 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-915f4eef-54b6-4ffb-ac51-998d3c680578 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:35.994473 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-915f4eef-54b6-4ffb-ac51-998d3c680578 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f31eba5c-d268-48b8-8d66-c1da93154cc4] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:36.002997 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-915f4eef-54b6-4ffb-ac51-998d3c680578 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:36.003918 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-915f4eef-54b6-4ffb-ac51-998d3c680578 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:36.005774 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-915f4eef-54b6-4ffb-ac51-998d3c680578 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:36.006853 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-915f4eef-54b6-4ffb-ac51-998d3c680578 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:36.164819 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-87320bdc-126d-4769-b3a6-758c0e147315 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:36.175426 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-87320bdc-126d-4769-b3a6-758c0e147315 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1726 microversion: 2.1 time: 0.271276 Jan 24 09:20:36.177474 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 302/596] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:35 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1726 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:36.199271 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-915f4eef-54b6-4ffb-ac51-998d3c680578 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:36.207327 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-915f4eef-54b6-4ffb-ac51-998d3c680578 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4" status: 200 len: 1281 microversion: 2.1 time: 0.222404 Jan 24 09:20:36.221144 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 295/597] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:35 2022] GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4 => generated 1281 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:36.348370 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-57c7bae7-024e-4b5b-8da1-1237ba376364 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:36.349378 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-57c7bae7-024e-4b5b-8da1-1237ba376364 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:36.356115 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-57c7bae7-024e-4b5b-8da1-1237ba376364 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:36.356661 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-57c7bae7-024e-4b5b-8da1-1237ba376364 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:36.357619 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-57c7bae7-024e-4b5b-8da1-1237ba376364 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:36.357969 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-57c7bae7-024e-4b5b-8da1-1237ba376364 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:36.470552 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-43a712c6-b50c-4cc3-b017-4bdf677d9bbc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:36.471237 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-43a712c6-b50c-4cc3-b017-4bdf677d9bbc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:36.482975 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-43a712c6-b50c-4cc3-b017-4bdf677d9bbc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:36.483510 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-43a712c6-b50c-4cc3-b017-4bdf677d9bbc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:36.484383 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-43a712c6-b50c-4cc3-b017-4bdf677d9bbc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:36.487892 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-43a712c6-b50c-4cc3-b017-4bdf677d9bbc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:36.557514 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-57c7bae7-024e-4b5b-8da1-1237ba376364 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:36.565938 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-57c7bae7-024e-4b5b-8da1-1237ba376364 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1571 microversion: 2.1 time: 0.221650 Jan 24 09:20:36.566682 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 303/598] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:36 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1571 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:36.666344 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-43a712c6-b50c-4cc3-b017-4bdf677d9bbc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:36.678780 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-43a712c6-b50c-4cc3-b017-4bdf677d9bbc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:36.680401 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-43a712c6-b50c-4cc3-b017-4bdf677d9bbc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:36.681897 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-43a712c6-b50c-4cc3-b017-4bdf677d9bbc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1743 microversion: 2.20 time: 0.215052 Jan 24 09:20:36.682509 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 296/599] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:20:36 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1743 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:20:37.194291 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-a3444fee-21ea-43e5-8dc6-ff91246c92c0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:37.194891 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-a3444fee-21ea-43e5-8dc6-ff91246c92c0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:37.201132 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a3444fee-21ea-43e5-8dc6-ff91246c92c0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:37.201578 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a3444fee-21ea-43e5-8dc6-ff91246c92c0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:37.202448 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a3444fee-21ea-43e5-8dc6-ff91246c92c0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:37.202891 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a3444fee-21ea-43e5-8dc6-ff91246c92c0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:37.229541 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-6b72a3cb-3a9a-43e0-a6d7-600795475aca tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:37.230205 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-6b72a3cb-3a9a-43e0-a6d7-600795475aca tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f31eba5c-d268-48b8-8d66-c1da93154cc4] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:37.236600 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6b72a3cb-3a9a-43e0-a6d7-600795475aca tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:37.237119 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6b72a3cb-3a9a-43e0-a6d7-600795475aca tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:37.237902 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6b72a3cb-3a9a-43e0-a6d7-600795475aca tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:37.238472 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6b72a3cb-3a9a-43e0-a6d7-600795475aca tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:37.341788 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-a3444fee-21ea-43e5-8dc6-ff91246c92c0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:37.350279 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-a3444fee-21ea-43e5-8dc6-ff91246c92c0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1726 microversion: 2.1 time: 0.160424 Jan 24 09:20:37.353744 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 304/600] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:37 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:37.374763 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-6b72a3cb-3a9a-43e0-a6d7-600795475aca tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:37.382736 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-6b72a3cb-3a9a-43e0-a6d7-600795475aca tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4" status: 200 len: 1281 microversion: 2.1 time: 0.157048 Jan 24 09:20:37.383307 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 297/601] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:37 2022] GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4 => generated 1281 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:20:37.583822 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-b305badd-20be-486e-9b5e-eeb6edca1217 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:37.584464 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-b305badd-20be-486e-9b5e-eeb6edca1217 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:37.590676 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b305badd-20be-486e-9b5e-eeb6edca1217 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:37.591062 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b305badd-20be-486e-9b5e-eeb6edca1217 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:37.591848 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b305badd-20be-486e-9b5e-eeb6edca1217 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:37.592337 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b305badd-20be-486e-9b5e-eeb6edca1217 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:37.702296 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-ee33aa67-a82b-4c6b-ad0a-a0e27b0fb7d8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:37.703666 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-ee33aa67-a82b-4c6b-ad0a-a0e27b0fb7d8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:37.713113 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ee33aa67-a82b-4c6b-ad0a-a0e27b0fb7d8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:37.714017 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ee33aa67-a82b-4c6b-ad0a-a0e27b0fb7d8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:37.717517 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ee33aa67-a82b-4c6b-ad0a-a0e27b0fb7d8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:37.718278 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ee33aa67-a82b-4c6b-ad0a-a0e27b0fb7d8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:37.747351 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-b305badd-20be-486e-9b5e-eeb6edca1217 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:37.761727 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-b305badd-20be-486e-9b5e-eeb6edca1217 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1571 microversion: 2.1 time: 0.182044 Jan 24 09:20:37.776562 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 305/602] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:37 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1571 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:37.895184 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-ee33aa67-a82b-4c6b-ad0a-a0e27b0fb7d8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:37.903667 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-ee33aa67-a82b-4c6b-ad0a-a0e27b0fb7d8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:37.905783 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-ee33aa67-a82b-4c6b-ad0a-a0e27b0fb7d8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:37.908156 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-ee33aa67-a82b-4c6b-ad0a-a0e27b0fb7d8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1743 microversion: 2.20 time: 0.210304 Jan 24 09:20:37.910666 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 298/603] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:20:37 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1743 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:20:38.369147 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-f12315b4-9286-4eb5-ac70-7f56c420ea52 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:38.369730 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-f12315b4-9286-4eb5-ac70-7f56c420ea52 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:38.377604 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f12315b4-9286-4eb5-ac70-7f56c420ea52 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:38.385964 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f12315b4-9286-4eb5-ac70-7f56c420ea52 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:38.385964 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f12315b4-9286-4eb5-ac70-7f56c420ea52 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:38.385964 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f12315b4-9286-4eb5-ac70-7f56c420ea52 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:38.401252 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-0bbaf40d-a51c-4bbb-941b-905448b4c17a tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:38.401988 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-0bbaf40d-a51c-4bbb-941b-905448b4c17a tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f31eba5c-d268-48b8-8d66-c1da93154cc4] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:38.409171 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0bbaf40d-a51c-4bbb-941b-905448b4c17a tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:38.409656 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0bbaf40d-a51c-4bbb-941b-905448b4c17a tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:38.411120 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0bbaf40d-a51c-4bbb-941b-905448b4c17a tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:38.411553 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0bbaf40d-a51c-4bbb-941b-905448b4c17a tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:38.551110 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-0bbaf40d-a51c-4bbb-941b-905448b4c17a tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:38.559146 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-0bbaf40d-a51c-4bbb-941b-905448b4c17a tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4" status: 200 len: 1281 microversion: 2.1 time: 0.162393 Jan 24 09:20:38.559920 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 299/604] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:38 2022] GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4 => generated 1281 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:38.601008 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-f12315b4-9286-4eb5-ac70-7f56c420ea52 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:38.609355 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-f12315b4-9286-4eb5-ac70-7f56c420ea52 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1726 microversion: 2.1 time: 0.243719 Jan 24 09:20:38.610260 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 306/605] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:38 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1726 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:38.779491 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-da342aed-50cf-4560-b88c-5534b998c8fd tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:38.780109 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-da342aed-50cf-4560-b88c-5534b998c8fd tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:38.786178 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-da342aed-50cf-4560-b88c-5534b998c8fd tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:38.786635 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-da342aed-50cf-4560-b88c-5534b998c8fd tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:38.787425 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-da342aed-50cf-4560-b88c-5534b998c8fd tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:38.787864 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-da342aed-50cf-4560-b88c-5534b998c8fd tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:38.929350 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-da342aed-50cf-4560-b88c-5534b998c8fd tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:38.932353 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-608ce547-6b47-4859-a448-98aeb84d9bbe tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:38.933116 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-608ce547-6b47-4859-a448-98aeb84d9bbe tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:38.938474 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-da342aed-50cf-4560-b88c-5534b998c8fd tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1571 microversion: 2.1 time: 0.162697 Jan 24 09:20:38.938972 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-608ce547-6b47-4859-a448-98aeb84d9bbe tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:38.944179 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 300/606] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:38 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1571 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:38.946230 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-608ce547-6b47-4859-a448-98aeb84d9bbe tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:38.947306 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-608ce547-6b47-4859-a448-98aeb84d9bbe tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:38.947819 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-608ce547-6b47-4859-a448-98aeb84d9bbe tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:39.187809 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-608ce547-6b47-4859-a448-98aeb84d9bbe tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:39.205943 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-608ce547-6b47-4859-a448-98aeb84d9bbe tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:39.208376 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-608ce547-6b47-4859-a448-98aeb84d9bbe tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:39.209887 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-608ce547-6b47-4859-a448-98aeb84d9bbe tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1743 microversion: 2.20 time: 0.281645 Jan 24 09:20:39.211036 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 307/607] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:20:38 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1743 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:20:39.434988 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [req-a9a6c12d-ebcd-4207-b21b-a50a4d9ae7f2 req-decf522b-91f0-4cbc-8fd7-6dbf4353c78b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f31eba5c-d268-48b8-8d66-c1da93154cc4", "tag": "6ecce77c-24a9-465d-84b4-0e5e56ded4dd"}]} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:20:39.436618 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:20:39.436618 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: warnings.warn(msg) Jan 24 09:20:39.445294 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-a9a6c12d-ebcd-4207-b21b-a50a4d9ae7f2 req-decf522b-91f0-4cbc-8fd7-6dbf4353c78b service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:39.446026 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-a9a6c12d-ebcd-4207-b21b-a50a4d9ae7f2 req-decf522b-91f0-4cbc-8fd7-6dbf4353c78b service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:39.459263 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.compute.server_external_events [req-a9a6c12d-ebcd-4207-b21b-a50a4d9ae7f2 req-decf522b-91f0-4cbc-8fd7-6dbf4353c78b service nova] Creating event network-changed:6ecce77c-24a9-465d-84b4-0e5e56ded4dd for instance f31eba5c-d268-48b8-8d66-c1da93154cc4 on hv-cinder-80403 Jan 24 09:20:39.466145 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [req-a9a6c12d-ebcd-4207-b21b-a50a4d9ae7f2 req-decf522b-91f0-4cbc-8fd7-6dbf4353c78b service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034744 Jan 24 09:20:39.467146 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 301/608] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:20:39.576901 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-fed14dc4-bf65-4197-b344-0ad822ed601c tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:39.577832 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-fed14dc4-bf65-4197-b344-0ad822ed601c tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f31eba5c-d268-48b8-8d66-c1da93154cc4] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:39.584632 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-fed14dc4-bf65-4197-b344-0ad822ed601c tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:39.585203 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-fed14dc4-bf65-4197-b344-0ad822ed601c tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:39.586156 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-fed14dc4-bf65-4197-b344-0ad822ed601c tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:39.586891 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-fed14dc4-bf65-4197-b344-0ad822ed601c tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:39.626316 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-b0aa6c7b-2499-4557-89d6-14d23563dd88 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:39.631861 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-b0aa6c7b-2499-4557-89d6-14d23563dd88 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: f73fa07f-65bf-45c0-afb7-c5bfb0356243] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:39.638177 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b0aa6c7b-2499-4557-89d6-14d23563dd88 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:39.638635 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b0aa6c7b-2499-4557-89d6-14d23563dd88 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:39.644053 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b0aa6c7b-2499-4557-89d6-14d23563dd88 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:39.644972 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b0aa6c7b-2499-4557-89d6-14d23563dd88 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:39.684933 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-b0aa6c7b-2499-4557-89d6-14d23563dd88 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: f73fa07f-65bf-45c0-afb7-c5bfb0356243] Going to try to terminate instance {{(pid=116864) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 09:20:39.892752 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-fed14dc4-bf65-4197-b344-0ad822ed601c tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:39.900491 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-fed14dc4-bf65-4197-b344-0ad822ed601c tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4" status: 200 len: 1281 microversion: 2.1 time: 0.328336 Jan 24 09:20:39.901095 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 308/609] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:39 2022] GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4 => generated 1281 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:39.909323 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-0b6ae470-9f59-4791-9d59-bfebe73c3e3e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:39.909323 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-0b6ae470-9f59-4791-9d59-bfebe73c3e3e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:39.915707 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0b6ae470-9f59-4791-9d59-bfebe73c3e3e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:39.922912 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0b6ae470-9f59-4791-9d59-bfebe73c3e3e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:39.922912 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0b6ae470-9f59-4791-9d59-bfebe73c3e3e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:39.922912 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0b6ae470-9f59-4791-9d59-bfebe73c3e3e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:40.064634 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-b0aa6c7b-2499-4557-89d6-14d23563dd88 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "DELETE /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243" status: 204 len: 0 microversion: 2.1 time: 0.442489 Jan 24 09:20:40.065576 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 302/610] 10.222.0.113 () {58 vars in 1243 bytes} [Mon Jan 24 09:20:39 2022] DELETE /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 24 09:20:40.072358 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-020e8b54-ef5d-490c-b767-5eee9f6a3192 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:40.072934 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-020e8b54-ef5d-490c-b767-5eee9f6a3192 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:40.079557 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-020e8b54-ef5d-490c-b767-5eee9f6a3192 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:40.080203 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-020e8b54-ef5d-490c-b767-5eee9f6a3192 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:40.081066 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-020e8b54-ef5d-490c-b767-5eee9f6a3192 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:40.081571 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-020e8b54-ef5d-490c-b767-5eee9f6a3192 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:40.229105 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-020e8b54-ef5d-490c-b767-5eee9f6a3192 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:40.237661 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-020e8b54-ef5d-490c-b767-5eee9f6a3192 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1571 microversion: 2.1 time: 0.170179 Jan 24 09:20:40.242433 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 303/611] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:40 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1571 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:40.247130 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-842c7ed6-dd82-4fc2-8c0c-529404274eed tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:40.247800 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-842c7ed6-dd82-4fc2-8c0c-529404274eed tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: f73fa07f-65bf-45c0-afb7-c5bfb0356243] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:40.253779 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-842c7ed6-dd82-4fc2-8c0c-529404274eed tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:40.254271 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-842c7ed6-dd82-4fc2-8c0c-529404274eed tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:40.255109 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-842c7ed6-dd82-4fc2-8c0c-529404274eed tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:40.255527 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-842c7ed6-dd82-4fc2-8c0c-529404274eed tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:40.375761 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-0b6ae470-9f59-4791-9d59-bfebe73c3e3e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:40.384596 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-0b6ae470-9f59-4791-9d59-bfebe73c3e3e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1726 microversion: 2.1 time: 0.482314 Jan 24 09:20:40.385191 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 309/612] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:39 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1726 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:40.389500 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-8121e111-7277-40de-ad0d-e4f5df61f42d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:40.390128 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-8121e111-7277-40de-ad0d-e4f5df61f42d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:40.391979 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-842c7ed6-dd82-4fc2-8c0c-529404274eed tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:40.396744 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8121e111-7277-40de-ad0d-e4f5df61f42d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:40.397189 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8121e111-7277-40de-ad0d-e4f5df61f42d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:40.397968 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8121e111-7277-40de-ad0d-e4f5df61f42d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:40.398426 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8121e111-7277-40de-ad0d-e4f5df61f42d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:40.400698 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-842c7ed6-dd82-4fc2-8c0c-529404274eed tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243" status: 200 len: 1518 microversion: 2.1 time: 0.157289 Jan 24 09:20:40.401276 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 304/613] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:40 2022] GET /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243 => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:40.530668 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-8121e111-7277-40de-ad0d-e4f5df61f42d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:40.538696 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-8121e111-7277-40de-ad0d-e4f5df61f42d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:40.540214 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-8121e111-7277-40de-ad0d-e4f5df61f42d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:40.541400 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-8121e111-7277-40de-ad0d-e4f5df61f42d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1725 microversion: 2.20 time: 0.155301 Jan 24 09:20:40.541956 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 310/614] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:20:40 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:20:40.916972 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-08a74b02-0967-4391-a753-f1b5e4b84712 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:40.917666 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-08a74b02-0967-4391-a753-f1b5e4b84712 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f31eba5c-d268-48b8-8d66-c1da93154cc4] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:40.924348 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-08a74b02-0967-4391-a753-f1b5e4b84712 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:40.924803 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-08a74b02-0967-4391-a753-f1b5e4b84712 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:40.925584 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-08a74b02-0967-4391-a753-f1b5e4b84712 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:40.926981 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-08a74b02-0967-4391-a753-f1b5e4b84712 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:41.056395 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-08a74b02-0967-4391-a753-f1b5e4b84712 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:41.063817 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-08a74b02-0967-4391-a753-f1b5e4b84712 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4" status: 200 len: 1269 microversion: 2.1 time: 0.150701 Jan 24 09:20:41.064392 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 305/615] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:40 2022] GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4 => generated 1269 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:41.256307 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-3fa90a86-b11a-495a-9935-17661fa3dc87 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:41.256831 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-3fa90a86-b11a-495a-9935-17661fa3dc87 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:41.263257 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3fa90a86-b11a-495a-9935-17661fa3dc87 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:41.263713 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3fa90a86-b11a-495a-9935-17661fa3dc87 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:41.264501 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3fa90a86-b11a-495a-9935-17661fa3dc87 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:41.264946 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3fa90a86-b11a-495a-9935-17661fa3dc87 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:41.395515 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-3fa90a86-b11a-495a-9935-17661fa3dc87 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:41.401050 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-1558bb74-d4f4-4fbd-a1f5-0dc805dbd77d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:41.401760 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-1558bb74-d4f4-4fbd-a1f5-0dc805dbd77d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:41.403697 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-3fa90a86-b11a-495a-9935-17661fa3dc87 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1571 microversion: 2.1 time: 0.152089 Jan 24 09:20:41.404528 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 311/616] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:41 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1571 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:41.407911 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1558bb74-d4f4-4fbd-a1f5-0dc805dbd77d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:41.408354 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1558bb74-d4f4-4fbd-a1f5-0dc805dbd77d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:41.409131 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1558bb74-d4f4-4fbd-a1f5-0dc805dbd77d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:41.409735 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1558bb74-d4f4-4fbd-a1f5-0dc805dbd77d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:41.416939 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-740ef562-6d20-4dd3-b7d1-7eec7983ca54 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:41.417819 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-740ef562-6d20-4dd3-b7d1-7eec7983ca54 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: f73fa07f-65bf-45c0-afb7-c5bfb0356243] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:41.423625 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-740ef562-6d20-4dd3-b7d1-7eec7983ca54 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:41.424336 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-740ef562-6d20-4dd3-b7d1-7eec7983ca54 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:41.425121 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-740ef562-6d20-4dd3-b7d1-7eec7983ca54 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:41.425744 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-740ef562-6d20-4dd3-b7d1-7eec7983ca54 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:41.543911 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-1558bb74-d4f4-4fbd-a1f5-0dc805dbd77d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:41.552620 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-1558bb74-d4f4-4fbd-a1f5-0dc805dbd77d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1726 microversion: 2.1 time: 0.155005 Jan 24 09:20:41.553232 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 306/617] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:41 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:20:41.560072 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-983179b9-bbcc-456b-af35-568a17fe4cd4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:41.561211 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-983179b9-bbcc-456b-af35-568a17fe4cd4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:41.563152 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-740ef562-6d20-4dd3-b7d1-7eec7983ca54 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:41.567709 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-983179b9-bbcc-456b-af35-568a17fe4cd4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:41.568163 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-983179b9-bbcc-456b-af35-568a17fe4cd4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:41.569004 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-983179b9-bbcc-456b-af35-568a17fe4cd4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:41.569387 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-983179b9-bbcc-456b-af35-568a17fe4cd4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:41.571180 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-740ef562-6d20-4dd3-b7d1-7eec7983ca54 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243" status: 200 len: 1518 microversion: 2.1 time: 0.157763 Jan 24 09:20:41.576550 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 312/618] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:41 2022] GET /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:20:41.715632 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-983179b9-bbcc-456b-af35-568a17fe4cd4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:41.724106 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-983179b9-bbcc-456b-af35-568a17fe4cd4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:41.725619 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-983179b9-bbcc-456b-af35-568a17fe4cd4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:41.726800 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-983179b9-bbcc-456b-af35-568a17fe4cd4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1725 microversion: 2.20 time: 0.170435 Jan 24 09:20:41.727369 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 307/619] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:20:41 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 09:20:42.081430 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-8aef73d9-ee72-4ed7-a908-b493373af01e tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:42.082044 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-8aef73d9-ee72-4ed7-a908-b493373af01e tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f31eba5c-d268-48b8-8d66-c1da93154cc4] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:42.088678 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8aef73d9-ee72-4ed7-a908-b493373af01e tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:42.089128 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8aef73d9-ee72-4ed7-a908-b493373af01e tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:42.089906 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8aef73d9-ee72-4ed7-a908-b493373af01e tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:42.090380 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8aef73d9-ee72-4ed7-a908-b493373af01e tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:42.219497 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-8aef73d9-ee72-4ed7-a908-b493373af01e tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:42.228101 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-8aef73d9-ee72-4ed7-a908-b493373af01e tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4" status: 200 len: 1269 microversion: 2.1 time: 0.150401 Jan 24 09:20:42.228680 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 313/620] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:42 2022] GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4 => generated 1269 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:42.421652 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-b65fd5a7-c309-4217-aaaa-b109aee9efd0 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:42.422215 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-b65fd5a7-c309-4217-aaaa-b109aee9efd0 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:42.429798 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b65fd5a7-c309-4217-aaaa-b109aee9efd0 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:42.430276 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b65fd5a7-c309-4217-aaaa-b109aee9efd0 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:42.431054 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b65fd5a7-c309-4217-aaaa-b109aee9efd0 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:42.431527 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b65fd5a7-c309-4217-aaaa-b109aee9efd0 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:42.563607 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-b65fd5a7-c309-4217-aaaa-b109aee9efd0 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:42.568634 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-d47d5942-5ee8-42b7-b072-38116bb2c3b8 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:42.569296 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-d47d5942-5ee8-42b7-b072-38116bb2c3b8 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:42.572095 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-b65fd5a7-c309-4217-aaaa-b109aee9efd0 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1571 microversion: 2.1 time: 0.154062 Jan 24 09:20:42.572680 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 308/621] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:42 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1571 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:20:42.575780 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d47d5942-5ee8-42b7-b072-38116bb2c3b8 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:42.576296 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d47d5942-5ee8-42b7-b072-38116bb2c3b8 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:42.577147 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d47d5942-5ee8-42b7-b072-38116bb2c3b8 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:42.577645 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d47d5942-5ee8-42b7-b072-38116bb2c3b8 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:42.587176 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-3c99748a-d5b0-4b7d-a98a-ca358d6d0493 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:42.587800 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-3c99748a-d5b0-4b7d-a98a-ca358d6d0493 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: f73fa07f-65bf-45c0-afb7-c5bfb0356243] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:42.593965 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3c99748a-d5b0-4b7d-a98a-ca358d6d0493 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:42.594435 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3c99748a-d5b0-4b7d-a98a-ca358d6d0493 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:42.595396 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3c99748a-d5b0-4b7d-a98a-ca358d6d0493 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:42.595826 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3c99748a-d5b0-4b7d-a98a-ca358d6d0493 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:42.719391 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-d47d5942-5ee8-42b7-b072-38116bb2c3b8 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:42.724267 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-d47d5942-5ee8-42b7-b072-38116bb2c3b8 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1726 microversion: 2.1 time: 0.159167 Jan 24 09:20:42.724872 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 314/622] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:42 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:20:42.733949 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-3c99748a-d5b0-4b7d-a98a-ca358d6d0493 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:42.742227 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-3c99748a-d5b0-4b7d-a98a-ca358d6d0493 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243" status: 200 len: 1518 microversion: 2.1 time: 0.158608 Jan 24 09:20:42.742965 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 309/623] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:42 2022] GET /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243 => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:20:42.745124 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-8d1344b1-714d-464c-bba7-443495d0c82a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:42.745732 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-8d1344b1-714d-464c-bba7-443495d0c82a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:42.751546 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8d1344b1-714d-464c-bba7-443495d0c82a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:42.751996 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8d1344b1-714d-464c-bba7-443495d0c82a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:42.752770 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8d1344b1-714d-464c-bba7-443495d0c82a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:42.753238 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8d1344b1-714d-464c-bba7-443495d0c82a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:42.883411 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-8d1344b1-714d-464c-bba7-443495d0c82a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:42.891177 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-8d1344b1-714d-464c-bba7-443495d0c82a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:42.892653 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-8d1344b1-714d-464c-bba7-443495d0c82a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:42.893782 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-8d1344b1-714d-464c-bba7-443495d0c82a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1725 microversion: 2.20 time: 0.152498 Jan 24 09:20:42.894401 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 315/624] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:20:42 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 09:20:43.244745 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-c83c5723-fe6d-4509-88f8-8c30af4c160a tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:43.245381 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-c83c5723-fe6d-4509-88f8-8c30af4c160a tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f31eba5c-d268-48b8-8d66-c1da93154cc4] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:43.251766 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c83c5723-fe6d-4509-88f8-8c30af4c160a tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:43.253502 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c83c5723-fe6d-4509-88f8-8c30af4c160a tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:43.253502 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c83c5723-fe6d-4509-88f8-8c30af4c160a tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:43.253755 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c83c5723-fe6d-4509-88f8-8c30af4c160a tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:43.325973 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [req-9fb7e24f-6939-439e-b337-030d15110a56 req-4ea4db86-19ee-4536-8e8c-c6cada198ce3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b820c156-179a-4172-a02b-6c88713087f1", "name": "network-vif-unplugged", "status": "completed", "tag": "73ec9bcf-7f40-4fd5-9968-de1accae6f03"}]} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:20:43.327601 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:20:43.327601 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: warnings.warn(msg) Jan 24 09:20:43.339121 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-9fb7e24f-6939-439e-b337-030d15110a56 req-4ea4db86-19ee-4536-8e8c-c6cada198ce3 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:43.339939 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-9fb7e24f-6939-439e-b337-030d15110a56 req-4ea4db86-19ee-4536-8e8c-c6cada198ce3 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:43.365750 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.compute.server_external_events [req-9fb7e24f-6939-439e-b337-030d15110a56 req-4ea4db86-19ee-4536-8e8c-c6cada198ce3 service nova] Creating event network-vif-unplugged:73ec9bcf-7f40-4fd5-9968-de1accae6f03 for instance b820c156-179a-4172-a02b-6c88713087f1 on hv-cinder-80403 Jan 24 09:20:43.365750 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [req-9fb7e24f-6939-439e-b337-030d15110a56 req-4ea4db86-19ee-4536-8e8c-c6cada198ce3 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035715 Jan 24 09:20:43.365750 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 316/625] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 09:20:43.405417 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-c83c5723-fe6d-4509-88f8-8c30af4c160a tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:43.413954 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-c83c5723-fe6d-4509-88f8-8c30af4c160a tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4" status: 200 len: 1269 microversion: 2.1 time: 0.172762 Jan 24 09:20:43.414694 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 310/626] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:43 2022] GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4 => generated 1269 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:43.589804 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-12cb4c4b-1fd3-4fb4-8a0a-4568ea7658e8 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:43.590653 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-12cb4c4b-1fd3-4fb4-8a0a-4568ea7658e8 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:43.596873 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-12cb4c4b-1fd3-4fb4-8a0a-4568ea7658e8 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:43.600598 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-12cb4c4b-1fd3-4fb4-8a0a-4568ea7658e8 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:43.600598 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-12cb4c4b-1fd3-4fb4-8a0a-4568ea7658e8 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:43.600598 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-12cb4c4b-1fd3-4fb4-8a0a-4568ea7658e8 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:43.742932 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-921d5236-7cd1-437d-9bc5-e4d1dd29cf85 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:43.743944 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-921d5236-7cd1-437d-9bc5-e4d1dd29cf85 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:43.750792 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-921d5236-7cd1-437d-9bc5-e4d1dd29cf85 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:43.751345 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-921d5236-7cd1-437d-9bc5-e4d1dd29cf85 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:43.753625 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-921d5236-7cd1-437d-9bc5-e4d1dd29cf85 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:43.753625 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-921d5236-7cd1-437d-9bc5-e4d1dd29cf85 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:43.878949 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-12cb4c4b-1fd3-4fb4-8a0a-4568ea7658e8 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:43.892775 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-12cb4c4b-1fd3-4fb4-8a0a-4568ea7658e8 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1571 microversion: 2.1 time: 0.307586 Jan 24 09:20:43.893375 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 317/627] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:43 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1571 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:43.901832 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-01023b68-4049-4155-a090-6f4d680dc632 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:43.902519 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-01023b68-4049-4155-a090-6f4d680dc632 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: f73fa07f-65bf-45c0-afb7-c5bfb0356243] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:43.906549 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-921d5236-7cd1-437d-9bc5-e4d1dd29cf85 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:43.912612 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-01023b68-4049-4155-a090-6f4d680dc632 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:43.913344 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-01023b68-4049-4155-a090-6f4d680dc632 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:43.914239 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-01023b68-4049-4155-a090-6f4d680dc632 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:43.914874 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-01023b68-4049-4155-a090-6f4d680dc632 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:43.915364 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-921d5236-7cd1-437d-9bc5-e4d1dd29cf85 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1726 microversion: 2.1 time: 0.177460 Jan 24 09:20:43.916261 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 311/628] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:43 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1726 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:43.920597 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-fa3bb2f1-532f-402e-9822-a8f4d0fde419 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:43.921195 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-fa3bb2f1-532f-402e-9822-a8f4d0fde419 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:43.921529 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 24 09:20:43.925790 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: Mon Jan 24 09:20:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243 (ip 10.222.0.113) !!! Jan 24 09:20:43.927874 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fa3bb2f1-532f-402e-9822-a8f4d0fde419 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:43.928330 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fa3bb2f1-532f-402e-9822-a8f4d0fde419 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:43.929164 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fa3bb2f1-532f-402e-9822-a8f4d0fde419 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:43.929604 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fa3bb2f1-532f-402e-9822-a8f4d0fde419 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:44.075670 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-01023b68-4049-4155-a090-6f4d680dc632 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:44.084542 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-01023b68-4049-4155-a090-6f4d680dc632 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243" status: 200 len: 1518 microversion: 2.1 time: 0.190156 Jan 24 09:20:44.085133 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 318/629] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:43 2022] GET /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243 => generated 1518 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:44.085680 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-fa3bb2f1-532f-402e-9822-a8f4d0fde419 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:44.093744 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-fa3bb2f1-532f-402e-9822-a8f4d0fde419 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:44.095346 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-fa3bb2f1-532f-402e-9822-a8f4d0fde419 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:44.096507 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-fa3bb2f1-532f-402e-9822-a8f4d0fde419 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1725 microversion: 2.20 time: 0.179276 Jan 24 09:20:44.097066 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 312/630] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:20:43 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:20:44.431107 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-872b6657-9960-4176-ad2a-e91b17e81ba7 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:44.431707 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-872b6657-9960-4176-ad2a-e91b17e81ba7 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f31eba5c-d268-48b8-8d66-c1da93154cc4] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:44.438852 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-872b6657-9960-4176-ad2a-e91b17e81ba7 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:44.439452 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-872b6657-9960-4176-ad2a-e91b17e81ba7 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:44.440250 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-872b6657-9960-4176-ad2a-e91b17e81ba7 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:44.440686 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-872b6657-9960-4176-ad2a-e91b17e81ba7 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:44.592470 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-872b6657-9960-4176-ad2a-e91b17e81ba7 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:44.600170 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-872b6657-9960-4176-ad2a-e91b17e81ba7 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4" status: 200 len: 1269 microversion: 2.1 time: 0.172578 Jan 24 09:20:44.600996 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 319/631] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:44 2022] GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4 => generated 1269 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:44.909801 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-ca51d9b1-2045-4510-86d0-5aa9f7986f2e tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:44.910439 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-ca51d9b1-2045-4510-86d0-5aa9f7986f2e tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:44.916842 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ca51d9b1-2045-4510-86d0-5aa9f7986f2e tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:44.917283 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ca51d9b1-2045-4510-86d0-5aa9f7986f2e tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:44.918059 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ca51d9b1-2045-4510-86d0-5aa9f7986f2e tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:44.918513 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ca51d9b1-2045-4510-86d0-5aa9f7986f2e tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:44.933444 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-bb148b3f-97a8-4e80-bc38-7a9e6e185790 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:44.934071 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-bb148b3f-97a8-4e80-bc38-7a9e6e185790 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:44.939869 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bb148b3f-97a8-4e80-bc38-7a9e6e185790 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:44.940345 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bb148b3f-97a8-4e80-bc38-7a9e6e185790 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:44.941122 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bb148b3f-97a8-4e80-bc38-7a9e6e185790 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:44.941549 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bb148b3f-97a8-4e80-bc38-7a9e6e185790 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:45.049974 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-ca51d9b1-2045-4510-86d0-5aa9f7986f2e tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:45.057992 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-ca51d9b1-2045-4510-86d0-5aa9f7986f2e tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1571 microversion: 2.1 time: 0.151812 Jan 24 09:20:45.058610 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 313/632] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:44 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1571 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:45.078374 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-bb148b3f-97a8-4e80-bc38-7a9e6e185790 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:45.086759 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-bb148b3f-97a8-4e80-bc38-7a9e6e185790 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1703 microversion: 2.1 time: 0.157252 Jan 24 09:20:45.087366 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 320/633] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:44 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1703 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:45.101209 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-a0ca28e6-6cf1-4653-ab82-4e035da4204c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:45.101821 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-a0ca28e6-6cf1-4653-ab82-4e035da4204c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: f73fa07f-65bf-45c0-afb7-c5bfb0356243] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:45.103262 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-125bb1a4-6dc8-4f96-b19c-cc2f42726887 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:20:45.107923 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a0ca28e6-6cf1-4653-ab82-4e035da4204c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:45.108447 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a0ca28e6-6cf1-4653-ab82-4e035da4204c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:45.108926 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-125bb1a4-6dc8-4f96-b19c-cc2f42726887 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:45.109266 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a0ca28e6-6cf1-4653-ab82-4e035da4204c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:45.109378 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-125bb1a4-6dc8-4f96-b19c-cc2f42726887 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:45.109705 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a0ca28e6-6cf1-4653-ab82-4e035da4204c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:45.132422 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-125bb1a4-6dc8-4f96-b19c-cc2f42726887 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Going to try to start instance {{(pid=116863) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 24 09:20:45.247340 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-a0ca28e6-6cf1-4653-ab82-4e035da4204c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:45.254902 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-a0ca28e6-6cf1-4653-ab82-4e035da4204c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243" status: 200 len: 1518 microversion: 2.1 time: 0.157630 Jan 24 09:20:45.255316 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 314/634] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:45 2022] GET /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:45.259753 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-4bfa95cd-a67f-4feb-9579-74f4cac2298a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:45.263891 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-4bfa95cd-a67f-4feb-9579-74f4cac2298a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:45.266018 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4bfa95cd-a67f-4feb-9579-74f4cac2298a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:45.266497 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4bfa95cd-a67f-4feb-9579-74f4cac2298a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:45.267298 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4bfa95cd-a67f-4feb-9579-74f4cac2298a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:45.267699 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4bfa95cd-a67f-4feb-9579-74f4cac2298a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:45.399635 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-4bfa95cd-a67f-4feb-9579-74f4cac2298a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:45.407457 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-4bfa95cd-a67f-4feb-9579-74f4cac2298a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:45.409122 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-4bfa95cd-a67f-4feb-9579-74f4cac2298a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:45.410321 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-4bfa95cd-a67f-4feb-9579-74f4cac2298a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1725 microversion: 2.20 time: 0.154001 Jan 24 09:20:45.411469 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 315/635] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:20:45 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:20:45.449497 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-125bb1a4-6dc8-4f96-b19c-cc2f42726887 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 202 len: 0 microversion: 2.1 time: 0.349435 Jan 24 09:20:45.450203 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 321/636] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:20:45 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 24 09:20:45.460181 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-5debed9f-ba9d-4280-86dc-c229ea831c59 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:45.460789 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-5debed9f-ba9d-4280-86dc-c229ea831c59 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:45.466883 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5debed9f-ba9d-4280-86dc-c229ea831c59 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:45.467330 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5debed9f-ba9d-4280-86dc-c229ea831c59 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:45.468102 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5debed9f-ba9d-4280-86dc-c229ea831c59 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:45.468543 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5debed9f-ba9d-4280-86dc-c229ea831c59 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:45.607149 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-5debed9f-ba9d-4280-86dc-c229ea831c59 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:45.616139 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-5debed9f-ba9d-4280-86dc-c229ea831c59 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1712 microversion: 2.1 time: 0.159862 Jan 24 09:20:45.616737 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 316/637] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:45 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1712 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:45.618265 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-9db71613-55d6-417d-948c-ef7a6a4a10c4 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:45.618965 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-9db71613-55d6-417d-948c-ef7a6a4a10c4 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f31eba5c-d268-48b8-8d66-c1da93154cc4] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:45.625078 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9db71613-55d6-417d-948c-ef7a6a4a10c4 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:45.625505 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9db71613-55d6-417d-948c-ef7a6a4a10c4 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:45.626660 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9db71613-55d6-417d-948c-ef7a6a4a10c4 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:45.626895 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9db71613-55d6-417d-948c-ef7a6a4a10c4 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:45.759970 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-9db71613-55d6-417d-948c-ef7a6a4a10c4 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:45.767267 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-9db71613-55d6-417d-948c-ef7a6a4a10c4 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4" status: 200 len: 1269 microversion: 2.1 time: 0.154234 Jan 24 09:20:45.767832 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 322/638] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:45 2022] GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4 => generated 1269 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:20:46.074989 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-5ebeb96f-1c19-4e27-8973-7182b18db0cb tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:46.075632 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-5ebeb96f-1c19-4e27-8973-7182b18db0cb tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:46.081941 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5ebeb96f-1c19-4e27-8973-7182b18db0cb tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:46.082431 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5ebeb96f-1c19-4e27-8973-7182b18db0cb tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:46.083879 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5ebeb96f-1c19-4e27-8973-7182b18db0cb tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:46.084316 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5ebeb96f-1c19-4e27-8973-7182b18db0cb tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:46.220478 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-5ebeb96f-1c19-4e27-8973-7182b18db0cb tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:46.228969 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-5ebeb96f-1c19-4e27-8973-7182b18db0cb tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1571 microversion: 2.1 time: 0.157727 Jan 24 09:20:46.229549 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 317/639] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:46 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1571 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:46.272206 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-e7f67216-3b41-4b78-a483-fbf7bc1f4da2 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:46.273005 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-e7f67216-3b41-4b78-a483-fbf7bc1f4da2 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: f73fa07f-65bf-45c0-afb7-c5bfb0356243] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:46.279004 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e7f67216-3b41-4b78-a483-fbf7bc1f4da2 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:46.279447 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e7f67216-3b41-4b78-a483-fbf7bc1f4da2 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:46.280217 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e7f67216-3b41-4b78-a483-fbf7bc1f4da2 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:46.280651 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e7f67216-3b41-4b78-a483-fbf7bc1f4da2 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:46.409910 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-e7f67216-3b41-4b78-a483-fbf7bc1f4da2 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:46.417421 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-e7f67216-3b41-4b78-a483-fbf7bc1f4da2 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243" status: 200 len: 1518 microversion: 2.1 time: 0.149751 Jan 24 09:20:46.417996 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 323/640] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:46 2022] GET /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243 => generated 1518 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:46.429707 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-08f59ed9-dac7-4b57-bb20-3bd5c3845823 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:46.430353 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-08f59ed9-dac7-4b57-bb20-3bd5c3845823 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:46.436269 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-08f59ed9-dac7-4b57-bb20-3bd5c3845823 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:46.436704 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-08f59ed9-dac7-4b57-bb20-3bd5c3845823 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:46.437494 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-08f59ed9-dac7-4b57-bb20-3bd5c3845823 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:46.438211 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-08f59ed9-dac7-4b57-bb20-3bd5c3845823 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:46.576995 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-08f59ed9-dac7-4b57-bb20-3bd5c3845823 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:46.582804 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-08f59ed9-dac7-4b57-bb20-3bd5c3845823 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:46.584373 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-08f59ed9-dac7-4b57-bb20-3bd5c3845823 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:46.585517 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-08f59ed9-dac7-4b57-bb20-3bd5c3845823 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1725 microversion: 2.20 time: 0.160443 Jan 24 09:20:46.586083 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 318/641] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:20:46 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:20:46.633348 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-bc385bab-8beb-48b5-ad0e-5c10e35c3cb1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:46.633910 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-bc385bab-8beb-48b5-ad0e-5c10e35c3cb1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:46.640308 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bc385bab-8beb-48b5-ad0e-5c10e35c3cb1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:46.640757 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bc385bab-8beb-48b5-ad0e-5c10e35c3cb1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:46.641536 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bc385bab-8beb-48b5-ad0e-5c10e35c3cb1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:46.641975 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bc385bab-8beb-48b5-ad0e-5c10e35c3cb1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:46.774934 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-bc385bab-8beb-48b5-ad0e-5c10e35c3cb1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:46.782799 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-bc385bab-8beb-48b5-ad0e-5c10e35c3cb1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1712 microversion: 2.1 time: 0.153986 Jan 24 09:20:46.783373 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 324/642] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:46 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1712 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:46.784800 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-eb876618-b912-4fc7-81fa-c9dcec4b7c98 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:46.785168 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-eb876618-b912-4fc7-81fa-c9dcec4b7c98 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f31eba5c-d268-48b8-8d66-c1da93154cc4] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:46.791580 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-eb876618-b912-4fc7-81fa-c9dcec4b7c98 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:46.792023 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-eb876618-b912-4fc7-81fa-c9dcec4b7c98 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:46.792812 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-eb876618-b912-4fc7-81fa-c9dcec4b7c98 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:46.793337 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-eb876618-b912-4fc7-81fa-c9dcec4b7c98 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:46.928739 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-eb876618-b912-4fc7-81fa-c9dcec4b7c98 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:46.936197 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-eb876618-b912-4fc7-81fa-c9dcec4b7c98 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4" status: 200 len: 1269 microversion: 2.1 time: 0.155363 Jan 24 09:20:46.936787 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 319/643] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:46 2022] GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4 => generated 1269 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:20:47.245872 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-bd6c1a26-c15a-4cfa-80b0-12ea95a745ee tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:47.246423 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-bd6c1a26-c15a-4cfa-80b0-12ea95a745ee tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:47.252467 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bd6c1a26-c15a-4cfa-80b0-12ea95a745ee tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:47.252919 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bd6c1a26-c15a-4cfa-80b0-12ea95a745ee tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:47.253701 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bd6c1a26-c15a-4cfa-80b0-12ea95a745ee tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:47.254166 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bd6c1a26-c15a-4cfa-80b0-12ea95a745ee tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:47.384284 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-bd6c1a26-c15a-4cfa-80b0-12ea95a745ee tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:47.392972 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-bd6c1a26-c15a-4cfa-80b0-12ea95a745ee tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1571 microversion: 2.1 time: 0.150865 Jan 24 09:20:47.393551 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 325/644] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:47 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1571 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:47.434626 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-cbe801b7-60a6-42f1-a408-31779ccf65d4 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:47.435401 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-cbe801b7-60a6-42f1-a408-31779ccf65d4 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: f73fa07f-65bf-45c0-afb7-c5bfb0356243] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:47.442870 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-cbe801b7-60a6-42f1-a408-31779ccf65d4 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:47.443234 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-cbe801b7-60a6-42f1-a408-31779ccf65d4 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:47.444029 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-cbe801b7-60a6-42f1-a408-31779ccf65d4 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:47.444461 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-cbe801b7-60a6-42f1-a408-31779ccf65d4 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:47.590136 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-cbe801b7-60a6-42f1-a408-31779ccf65d4 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:47.598389 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-cbe801b7-60a6-42f1-a408-31779ccf65d4 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243" status: 200 len: 1518 microversion: 2.1 time: 0.167331 Jan 24 09:20:47.599189 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 320/645] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:47 2022] GET /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243 => generated 1518 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:47.603925 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-831c4a21-2971-4a49-b848-a90e9a07b50b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:47.604578 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-831c4a21-2971-4a49-b848-a90e9a07b50b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:47.610768 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-831c4a21-2971-4a49-b848-a90e9a07b50b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:47.611216 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-831c4a21-2971-4a49-b848-a90e9a07b50b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:47.612000 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-831c4a21-2971-4a49-b848-a90e9a07b50b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:47.612445 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-831c4a21-2971-4a49-b848-a90e9a07b50b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:47.756685 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-831c4a21-2971-4a49-b848-a90e9a07b50b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:47.764752 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-831c4a21-2971-4a49-b848-a90e9a07b50b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:47.766298 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-831c4a21-2971-4a49-b848-a90e9a07b50b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:47.767453 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-831c4a21-2971-4a49-b848-a90e9a07b50b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1725 microversion: 2.20 time: 0.167219 Jan 24 09:20:47.768014 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 326/646] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:20:47 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:20:47.803692 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-2fdf537b-ca9c-4513-9f86-8a46f3729a8f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:47.804589 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-2fdf537b-ca9c-4513-9f86-8a46f3729a8f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:47.812990 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2fdf537b-ca9c-4513-9f86-8a46f3729a8f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:47.813655 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2fdf537b-ca9c-4513-9f86-8a46f3729a8f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:47.814879 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2fdf537b-ca9c-4513-9f86-8a46f3729a8f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:47.815546 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2fdf537b-ca9c-4513-9f86-8a46f3729a8f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:47.952824 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-4384669c-3308-4362-b65e-4e4e39735506 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:47.953437 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-4384669c-3308-4362-b65e-4e4e39735506 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f31eba5c-d268-48b8-8d66-c1da93154cc4] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:47.960851 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4384669c-3308-4362-b65e-4e4e39735506 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:47.961377 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4384669c-3308-4362-b65e-4e4e39735506 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:47.962318 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4384669c-3308-4362-b65e-4e4e39735506 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:47.962758 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4384669c-3308-4362-b65e-4e4e39735506 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:47.969190 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-2fdf537b-ca9c-4513-9f86-8a46f3729a8f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:47.978373 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-2fdf537b-ca9c-4513-9f86-8a46f3729a8f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1712 microversion: 2.1 time: 0.181346 Jan 24 09:20:47.987887 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 321/647] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:47 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1712 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:48.128772 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-4384669c-3308-4362-b65e-4e4e39735506 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:48.136633 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-4384669c-3308-4362-b65e-4e4e39735506 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4" status: 200 len: 1269 microversion: 2.1 time: 0.187430 Jan 24 09:20:48.137241 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 327/648] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:47 2022] GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4 => generated 1269 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:20:48.409993 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-38a36727-012a-448f-9a25-2a852b31a6e5 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:48.411520 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-38a36727-012a-448f-9a25-2a852b31a6e5 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:48.417657 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-38a36727-012a-448f-9a25-2a852b31a6e5 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:48.418120 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-38a36727-012a-448f-9a25-2a852b31a6e5 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:48.418927 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-38a36727-012a-448f-9a25-2a852b31a6e5 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:48.419362 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-38a36727-012a-448f-9a25-2a852b31a6e5 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:48.573096 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-38a36727-012a-448f-9a25-2a852b31a6e5 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:48.602306 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-38a36727-012a-448f-9a25-2a852b31a6e5 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1571 microversion: 2.1 time: 0.184829 Jan 24 09:20:48.602306 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 322/649] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:48 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1571 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:48.616908 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-390319d2-c899-4244-ad01-444968e60018 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:48.618178 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-390319d2-c899-4244-ad01-444968e60018 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: f73fa07f-65bf-45c0-afb7-c5bfb0356243] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:48.625833 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-390319d2-c899-4244-ad01-444968e60018 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:48.626429 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-390319d2-c899-4244-ad01-444968e60018 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:48.627643 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-390319d2-c899-4244-ad01-444968e60018 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:48.628191 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-390319d2-c899-4244-ad01-444968e60018 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:48.786768 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-a85d1e0a-98a5-4be0-bdca-22fe3881afde tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:48.788285 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-a85d1e0a-98a5-4be0-bdca-22fe3881afde tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:48.794648 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a85d1e0a-98a5-4be0-bdca-22fe3881afde tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:48.795099 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a85d1e0a-98a5-4be0-bdca-22fe3881afde tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:48.796214 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a85d1e0a-98a5-4be0-bdca-22fe3881afde tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:48.796751 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a85d1e0a-98a5-4be0-bdca-22fe3881afde tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:48.945878 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-390319d2-c899-4244-ad01-444968e60018 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:48.962346 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-390319d2-c899-4244-ad01-444968e60018 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243" status: 200 len: 1518 microversion: 2.1 time: 0.351534 Jan 24 09:20:48.963276 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 328/650] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:48 2022] GET /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243 => generated 1518 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:20:48.996879 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-862ee54a-03e5-4460-a110-cda813573da0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:48.999464 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-862ee54a-03e5-4460-a110-cda813573da0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:49.003633 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-a85d1e0a-98a5-4be0-bdca-22fe3881afde tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:49.013188 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-a85d1e0a-98a5-4be0-bdca-22fe3881afde tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:49.014575 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-862ee54a-03e5-4460-a110-cda813573da0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:49.014755 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-a85d1e0a-98a5-4be0-bdca-22fe3881afde tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:49.015862 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-862ee54a-03e5-4460-a110-cda813573da0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:49.015986 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-a85d1e0a-98a5-4be0-bdca-22fe3881afde tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1725 microversion: 2.20 time: 0.234080 Jan 24 09:20:49.016456 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 323/651] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:20:48 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1725 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 09:20:49.017922 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-862ee54a-03e5-4460-a110-cda813573da0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:49.019108 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-862ee54a-03e5-4460-a110-cda813573da0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:49.153506 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-fc0f10f8-311c-41da-84a9-2ae24969f6e7 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:49.154526 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-fc0f10f8-311c-41da-84a9-2ae24969f6e7 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f31eba5c-d268-48b8-8d66-c1da93154cc4] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:49.164335 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fc0f10f8-311c-41da-84a9-2ae24969f6e7 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:49.164335 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fc0f10f8-311c-41da-84a9-2ae24969f6e7 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:49.164335 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fc0f10f8-311c-41da-84a9-2ae24969f6e7 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:49.164335 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fc0f10f8-311c-41da-84a9-2ae24969f6e7 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:49.175333 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-862ee54a-03e5-4460-a110-cda813573da0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:49.186379 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-862ee54a-03e5-4460-a110-cda813573da0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1712 microversion: 2.1 time: 0.193892 Jan 24 09:20:49.187473 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 329/652] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:48 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1712 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:20:49.334012 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [req-6ec0b583-70c4-413b-93e9-9281d8de19b2 req-be9ec035-5a21-4d05-aa07-394d32d302d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f73fa07f-65bf-45c0-afb7-c5bfb0356243", "name": "network-vif-deleted", "tag": "03ee32c8-006e-44bb-8ead-c281985d4343"}]} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:20:49.335811 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:20:49.335811 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: warnings.warn(msg) Jan 24 09:20:49.344325 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-6ec0b583-70c4-413b-93e9-9281d8de19b2 req-be9ec035-5a21-4d05-aa07-394d32d302d3 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:49.344778 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-6ec0b583-70c4-413b-93e9-9281d8de19b2 req-be9ec035-5a21-4d05-aa07-394d32d302d3 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:49.358986 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-fc0f10f8-311c-41da-84a9-2ae24969f6e7 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:49.365493 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.compute.server_external_events [req-6ec0b583-70c4-413b-93e9-9281d8de19b2 req-be9ec035-5a21-4d05-aa07-394d32d302d3 service nova] Creating event network-vif-deleted:03ee32c8-006e-44bb-8ead-c281985d4343 for instance f73fa07f-65bf-45c0-afb7-c5bfb0356243 on hv-cinder-80403 Jan 24 09:20:49.369659 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-fc0f10f8-311c-41da-84a9-2ae24969f6e7 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4" status: 200 len: 1269 microversion: 2.1 time: 0.219635 Jan 24 09:20:49.370288 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 324/653] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:49 2022] GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4 => generated 1269 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:20:49.371186 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [req-6ec0b583-70c4-413b-93e9-9281d8de19b2 req-be9ec035-5a21-4d05-aa07-394d32d302d3 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041665 Jan 24 09:20:49.372161 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 330/654] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 09:20:49.608495 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-b5d5b5e6-23a5-4c78-bd72-b3e08edfb2c0 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:49.609121 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-b5d5b5e6-23a5-4c78-bd72-b3e08edfb2c0 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:49.616234 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b5d5b5e6-23a5-4c78-bd72-b3e08edfb2c0 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:49.616690 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b5d5b5e6-23a5-4c78-bd72-b3e08edfb2c0 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:49.617494 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b5d5b5e6-23a5-4c78-bd72-b3e08edfb2c0 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:49.617934 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b5d5b5e6-23a5-4c78-bd72-b3e08edfb2c0 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:49.759336 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-b5d5b5e6-23a5-4c78-bd72-b3e08edfb2c0 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:49.770398 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-b5d5b5e6-23a5-4c78-bd72-b3e08edfb2c0 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1551 microversion: 2.1 time: 0.165528 Jan 24 09:20:49.771000 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 325/655] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:49 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1551 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:49.788320 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-9eabba8e-2975-4004-99ec-ed3b3b43458c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:49.788914 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-9eabba8e-2975-4004-99ec-ed3b3b43458c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:49.795528 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9eabba8e-2975-4004-99ec-ed3b3b43458c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:49.795976 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9eabba8e-2975-4004-99ec-ed3b3b43458c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:49.796769 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9eabba8e-2975-4004-99ec-ed3b3b43458c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:49.797202 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9eabba8e-2975-4004-99ec-ed3b3b43458c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:49.877781 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.wsgi [None req-9eabba8e-2975-4004-99ec-ed3b3b43458c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] HTTP exception thrown: Cannot 'detach_volume' instance 047cd9d3-84f2-4cb0-a2ff-1439420b4f84 while it is in vm_state rescued Jan 24 09:20:49.878394 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-9eabba8e-2975-4004-99ec-ed3b3b43458c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Returning 409 to user: Cannot 'detach_volume' instance 047cd9d3-84f2-4cb0-a2ff-1439420b4f84 while it is in vm_state rescued {{(pid=116863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:20:49.879226 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-9eabba8e-2975-4004-99ec-ed3b3b43458c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "DELETE /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84/os-volume_attachments/30bdf825-81d0-458d-8a06-ca5e9985b57e" status: 409 len: 152 microversion: 2.1 time: 0.095987 Jan 24 09:20:49.880002 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 331/656] 10.222.0.113 () {58 vars in 1420 bytes} [Mon Jan 24 09:20:49 2022] DELETE /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84/os-volume_attachments/30bdf825-81d0-458d-8a06-ca5e9985b57e => generated 152 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 24 09:20:49.889160 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-12ac7d69-c942-44dd-acec-ed0319c06e0a tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:20:49.889683 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-12ac7d69-c942-44dd-acec-ed0319c06e0a tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:49.895971 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-12ac7d69-c942-44dd-acec-ed0319c06e0a tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:49.896424 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-12ac7d69-c942-44dd-acec-ed0319c06e0a tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:49.897191 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-12ac7d69-c942-44dd-acec-ed0319c06e0a tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:49.897623 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-12ac7d69-c942-44dd-acec-ed0319c06e0a tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:49.983694 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-23cb7c77-35b2-4c21-8f36-11f88d348873 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:49.984251 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-23cb7c77-35b2-4c21-8f36-11f88d348873 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: f73fa07f-65bf-45c0-afb7-c5bfb0356243] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:49.990367 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-23cb7c77-35b2-4c21-8f36-11f88d348873 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:49.994318 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-23cb7c77-35b2-4c21-8f36-11f88d348873 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:49.994318 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-23cb7c77-35b2-4c21-8f36-11f88d348873 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:49.994318 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-23cb7c77-35b2-4c21-8f36-11f88d348873 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:50.024341 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-23cb7c77-35b2-4c21-8f36-11f88d348873 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:50.024781 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-23cb7c77-35b2-4c21-8f36-11f88d348873 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:50.025229 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.objects.instance [None req-23cb7c77-35b2-4c21-8f36-11f88d348873 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lazy-loading 'fault' on Instance uuid f73fa07f-65bf-45c0-afb7-c5bfb0356243 {{(pid=116863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 09:20:50.075649 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-23cb7c77-35b2-4c21-8f36-11f88d348873 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:50.084273 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-23cb7c77-35b2-4c21-8f36-11f88d348873 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243" status: 200 len: 1312 microversion: 2.1 time: 0.104090 Jan 24 09:20:50.084846 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 332/657] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:49 2022] GET /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243 => generated 1312 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:20:50.089175 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-930d6ba3-d71e-4384-8c3b-0e6233fbece2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:50.089777 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-930d6ba3-d71e-4384-8c3b-0e6233fbece2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:50.095480 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-930d6ba3-d71e-4384-8c3b-0e6233fbece2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:50.095923 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-930d6ba3-d71e-4384-8c3b-0e6233fbece2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:50.096705 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-930d6ba3-d71e-4384-8c3b-0e6233fbece2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:50.097135 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-930d6ba3-d71e-4384-8c3b-0e6233fbece2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:50.221305 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-12ac7d69-c942-44dd-acec-ed0319c06e0a tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "POST /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84/action" status: 202 len: 0 microversion: 2.1 time: 0.335606 Jan 24 09:20:50.221963 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 326/658] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:20:49 2022] POST /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:20:50.227189 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-190068d6-321c-40b4-8b3d-6a85ccd83e9b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:50.228225 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-190068d6-321c-40b4-8b3d-6a85ccd83e9b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:50.231144 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-930d6ba3-d71e-4384-8c3b-0e6233fbece2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:50.235468 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-190068d6-321c-40b4-8b3d-6a85ccd83e9b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:50.235941 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-190068d6-321c-40b4-8b3d-6a85ccd83e9b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:50.236810 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-190068d6-321c-40b4-8b3d-6a85ccd83e9b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:50.237429 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-190068d6-321c-40b4-8b3d-6a85ccd83e9b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:50.240001 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-930d6ba3-d71e-4384-8c3b-0e6233fbece2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:50.241631 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-930d6ba3-d71e-4384-8c3b-0e6233fbece2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:50.242904 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-930d6ba3-d71e-4384-8c3b-0e6233fbece2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1728 microversion: 2.20 time: 0.157143 Jan 24 09:20:50.243467 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 333/659] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:20:50 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:20:50.247695 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-13a5e846-2003-4e7d-9092-d292c8647739 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:50.248292 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-13a5e846-2003-4e7d-9092-d292c8647739 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:50.260725 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-13a5e846-2003-4e7d-9092-d292c8647739 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:50.261179 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-13a5e846-2003-4e7d-9092-d292c8647739 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:50.262015 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-13a5e846-2003-4e7d-9092-d292c8647739 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:50.263777 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-13a5e846-2003-4e7d-9092-d292c8647739 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:50.388593 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-190068d6-321c-40b4-8b3d-6a85ccd83e9b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:50.396532 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-190068d6-321c-40b4-8b3d-6a85ccd83e9b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1712 microversion: 2.1 time: 0.173219 Jan 24 09:20:50.397116 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 327/660] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:50 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1712 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:50.401897 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-7f1bc623-0261-46d5-ab4b-a85ef5b713b3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e52e7031-3a8e-466d-bf66-f2405891add7"}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:20:50.403049 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-7f1bc623-0261-46d5-ab4b-a85ef5b713b3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:50.408971 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-7f1bc623-0261-46d5-ab4b-a85ef5b713b3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:50.409480 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-7f1bc623-0261-46d5-ab4b-a85ef5b713b3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:50.410303 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-7f1bc623-0261-46d5-ab4b-a85ef5b713b3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:50.410778 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-7f1bc623-0261-46d5-ab4b-a85ef5b713b3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:50.448201 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-13a5e846-2003-4e7d-9092-d292c8647739 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:50.456788 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-13a5e846-2003-4e7d-9092-d292c8647739 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1559 microversion: 2.1 time: 0.212285 Jan 24 09:20:50.463899 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 334/661] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:50 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:50.470952 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-bfa703fa-33c2-4e64-a07a-b98b4bb26115 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:50.471728 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-bfa703fa-33c2-4e64-a07a-b98b4bb26115 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f31eba5c-d268-48b8-8d66-c1da93154cc4] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:50.481316 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bfa703fa-33c2-4e64-a07a-b98b4bb26115 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:50.483937 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bfa703fa-33c2-4e64-a07a-b98b4bb26115 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:50.483937 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bfa703fa-33c2-4e64-a07a-b98b4bb26115 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:50.483937 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bfa703fa-33c2-4e64-a07a-b98b4bb26115 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:50.724838 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-bfa703fa-33c2-4e64-a07a-b98b4bb26115 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:50.732395 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-bfa703fa-33c2-4e64-a07a-b98b4bb26115 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4" status: 200 len: 1269 microversion: 2.1 time: 0.265299 Jan 24 09:20:50.732980 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 335/662] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:50 2022] GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4 => generated 1269 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:51.101644 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-6d2977b4-2a18-4db6-9784-a498d328194b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:51.103094 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-6d2977b4-2a18-4db6-9784-a498d328194b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: f73fa07f-65bf-45c0-afb7-c5bfb0356243] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:51.110121 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6d2977b4-2a18-4db6-9784-a498d328194b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:51.110929 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6d2977b4-2a18-4db6-9784-a498d328194b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:51.111947 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6d2977b4-2a18-4db6-9784-a498d328194b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:51.112467 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6d2977b4-2a18-4db6-9784-a498d328194b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:51.128391 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.wsgi [None req-6d2977b4-2a18-4db6-9784-a498d328194b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] HTTP exception thrown: Instance f73fa07f-65bf-45c0-afb7-c5bfb0356243 could not be found. Jan 24 09:20:51.129083 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-6d2977b4-2a18-4db6-9784-a498d328194b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Returning 404 to user: Instance f73fa07f-65bf-45c0-afb7-c5bfb0356243 could not be found. {{(pid=116863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:20:51.130666 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-6d2977b4-2a18-4db6-9784-a498d328194b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243" status: 404 len: 111 microversion: 2.1 time: 0.033185 Jan 24 09:20:51.131309 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 336/663] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:51 2022] GET /compute/v2.1/servers/f73fa07f-65bf-45c0-afb7-c5bfb0356243 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 24 09:20:51.139132 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-9d773e57-09bf-4dd9-8bdc-7af470f60efa tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:51.139716 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-9d773e57-09bf-4dd9-8bdc-7af470f60efa tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 6b0c5b63-d2d9-4dbd-b01d-845151d57d74] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:51.145981 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9d773e57-09bf-4dd9-8bdc-7af470f60efa tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:51.151431 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9d773e57-09bf-4dd9-8bdc-7af470f60efa tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:51.151431 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9d773e57-09bf-4dd9-8bdc-7af470f60efa tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:51.151431 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9d773e57-09bf-4dd9-8bdc-7af470f60efa tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:51.177939 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-9d773e57-09bf-4dd9-8bdc-7af470f60efa tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 6b0c5b63-d2d9-4dbd-b01d-845151d57d74] Going to try to terminate instance {{(pid=116863) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 09:20:51.650560 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-9d773e57-09bf-4dd9-8bdc-7af470f60efa tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "DELETE /compute/v2.1/servers/6b0c5b63-d2d9-4dbd-b01d-845151d57d74" status: 204 len: 0 microversion: 2.1 time: 0.514583 Jan 24 09:20:51.651150 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 337/664] 10.222.0.113 () {58 vars in 1243 bytes} [Mon Jan 24 09:20:51 2022] DELETE /compute/v2.1/servers/6b0c5b63-d2d9-4dbd-b01d-845151d57d74 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 24 09:20:51.656141 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-a2b717c8-b411-4542-8970-c7087276e60f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:51.656877 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-a2b717c8-b411-4542-8970-c7087276e60f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:51.663973 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a2b717c8-b411-4542-8970-c7087276e60f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:51.664415 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a2b717c8-b411-4542-8970-c7087276e60f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:51.665193 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a2b717c8-b411-4542-8970-c7087276e60f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:51.665619 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a2b717c8-b411-4542-8970-c7087276e60f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:51.809785 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-a2b717c8-b411-4542-8970-c7087276e60f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:51.818132 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-a2b717c8-b411-4542-8970-c7087276e60f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1716 microversion: 2.1 time: 0.165833 Jan 24 09:20:51.818708 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 338/665] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:51 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1716 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:51.822958 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-ea1b2165-cdc0-40f6-b897-4da42d017242 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:51.823555 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-ea1b2165-cdc0-40f6-b897-4da42d017242 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:51.829647 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ea1b2165-cdc0-40f6-b897-4da42d017242 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:51.830091 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ea1b2165-cdc0-40f6-b897-4da42d017242 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:51.832053 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ea1b2165-cdc0-40f6-b897-4da42d017242 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:51.832053 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ea1b2165-cdc0-40f6-b897-4da42d017242 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:51.965910 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-7f1bc623-0261-46d5-ab4b-a85ef5b713b3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.567506 Jan 24 09:20:51.966703 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 328/666] 10.222.0.113 () {62 vars in 1368 bytes} [Mon Jan 24 09:20:50 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/os-volume_attachments => generated 188 bytes in 1569 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:20:51.977843 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-5e780171-fe56-4606-aa2e-bbbc1778b38c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:51.977843 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-5e780171-fe56-4606-aa2e-bbbc1778b38c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 6b0c5b63-d2d9-4dbd-b01d-845151d57d74] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:51.980157 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5e780171-fe56-4606-aa2e-bbbc1778b38c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:51.980843 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5e780171-fe56-4606-aa2e-bbbc1778b38c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:51.981642 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5e780171-fe56-4606-aa2e-bbbc1778b38c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:51.982193 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5e780171-fe56-4606-aa2e-bbbc1778b38c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:51.994488 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-ea1b2165-cdc0-40f6-b897-4da42d017242 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:52.004010 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-ea1b2165-cdc0-40f6-b897-4da42d017242 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1559 microversion: 2.1 time: 0.184271 Jan 24 09:20:52.004959 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 339/667] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:51 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:52.009365 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-314098ae-c046-4c98-a35d-8d5a6dc35503 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:52.009982 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-314098ae-c046-4c98-a35d-8d5a6dc35503 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f31eba5c-d268-48b8-8d66-c1da93154cc4] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:52.019723 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-314098ae-c046-4c98-a35d-8d5a6dc35503 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:52.020903 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-314098ae-c046-4c98-a35d-8d5a6dc35503 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:52.022022 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-314098ae-c046-4c98-a35d-8d5a6dc35503 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:52.022492 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-314098ae-c046-4c98-a35d-8d5a6dc35503 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:52.143520 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-5e780171-fe56-4606-aa2e-bbbc1778b38c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:52.152246 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-5e780171-fe56-4606-aa2e-bbbc1778b38c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/6b0c5b63-d2d9-4dbd-b01d-845151d57d74" status: 200 len: 1518 microversion: 2.1 time: 0.184615 Jan 24 09:20:52.155687 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 329/668] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:51 2022] GET /compute/v2.1/servers/6b0c5b63-d2d9-4dbd-b01d-845151d57d74 => generated 1518 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:52.159970 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-0abd3ee5-d5da-4486-a2f2-3466d538731f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:20:52.160682 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-0abd3ee5-d5da-4486-a2f2-3466d538731f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:52.166577 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0abd3ee5-d5da-4486-a2f2-3466d538731f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:52.167022 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0abd3ee5-d5da-4486-a2f2-3466d538731f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:52.167794 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0abd3ee5-d5da-4486-a2f2-3466d538731f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:52.168253 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0abd3ee5-d5da-4486-a2f2-3466d538731f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:52.195648 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-314098ae-c046-4c98-a35d-8d5a6dc35503 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:52.203758 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-314098ae-c046-4c98-a35d-8d5a6dc35503 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4" status: 200 len: 1269 microversion: 2.1 time: 0.197787 Jan 24 09:20:52.204332 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 340/669] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:52 2022] GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4 => generated 1269 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:52.437839 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-0abd3ee5-d5da-4486-a2f2-3466d538731f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action" status: 202 len: 0 microversion: 2.20 time: 0.283190 Jan 24 09:20:52.437839 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 330/670] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:20:52 2022] POST /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 24 09:20:52.446294 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-08ee1266-4143-4421-bc19-1ef4360d5842 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:52.446906 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-08ee1266-4143-4421-bc19-1ef4360d5842 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:52.456707 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-08ee1266-4143-4421-bc19-1ef4360d5842 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:52.458141 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-08ee1266-4143-4421-bc19-1ef4360d5842 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:52.458903 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-08ee1266-4143-4421-bc19-1ef4360d5842 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:52.459343 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-08ee1266-4143-4421-bc19-1ef4360d5842 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:52.604018 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-08ee1266-4143-4421-bc19-1ef4360d5842 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:52.612445 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-08ee1266-4143-4421-bc19-1ef4360d5842 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:52.620280 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-08ee1266-4143-4421-bc19-1ef4360d5842 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:52.620280 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-08ee1266-4143-4421-bc19-1ef4360d5842 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1754 microversion: 2.20 time: 0.173339 Jan 24 09:20:52.620280 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 341/671] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:20:52 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:20:53.022377 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-a672cc7d-733e-4cee-8d53-3f7c3cb138d3 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:53.023036 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-a672cc7d-733e-4cee-8d53-3f7c3cb138d3 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:53.029774 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a672cc7d-733e-4cee-8d53-3f7c3cb138d3 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:53.030252 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a672cc7d-733e-4cee-8d53-3f7c3cb138d3 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:53.031044 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a672cc7d-733e-4cee-8d53-3f7c3cb138d3 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:53.031479 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a672cc7d-733e-4cee-8d53-3f7c3cb138d3 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:53.168598 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-2c657151-4ec8-4123-bbd2-ace95732a8d7 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:53.169558 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-2c657151-4ec8-4123-bbd2-ace95732a8d7 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 6b0c5b63-d2d9-4dbd-b01d-845151d57d74] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:53.179127 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-a672cc7d-733e-4cee-8d53-3f7c3cb138d3 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:53.187642 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-a672cc7d-733e-4cee-8d53-3f7c3cb138d3 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1559 microversion: 2.1 time: 0.169738 Jan 24 09:20:53.188481 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 331/672] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:53 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:53.198861 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-2c657151-4ec8-4123-bbd2-ace95732a8d7 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:53.198861 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-2c657151-4ec8-4123-bbd2-ace95732a8d7 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:53.198861 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-2c657151-4ec8-4123-bbd2-ace95732a8d7 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:53.198861 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-2c657151-4ec8-4123-bbd2-ace95732a8d7 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:53.224465 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-3524e08c-233a-4f7c-acc4-3b62747256de tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:53.225191 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-3524e08c-233a-4f7c-acc4-3b62747256de tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f31eba5c-d268-48b8-8d66-c1da93154cc4] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:53.231870 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3524e08c-233a-4f7c-acc4-3b62747256de tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:53.232831 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3524e08c-233a-4f7c-acc4-3b62747256de tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:53.233981 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3524e08c-233a-4f7c-acc4-3b62747256de tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:53.235904 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3524e08c-233a-4f7c-acc4-3b62747256de tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:53.419871 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-2c657151-4ec8-4123-bbd2-ace95732a8d7 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:53.433859 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-2c657151-4ec8-4123-bbd2-ace95732a8d7 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/6b0c5b63-d2d9-4dbd-b01d-845151d57d74" status: 200 len: 1518 microversion: 2.1 time: 0.268073 Jan 24 09:20:53.434834 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 342/673] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:53 2022] GET /compute/v2.1/servers/6b0c5b63-d2d9-4dbd-b01d-845151d57d74 => generated 1518 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:20:53.470821 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-3524e08c-233a-4f7c-acc4-3b62747256de tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:53.482678 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-3524e08c-233a-4f7c-acc4-3b62747256de tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4" status: 200 len: 1269 microversion: 2.1 time: 0.262142 Jan 24 09:20:53.486788 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 332/674] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:53 2022] GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4 => generated 1269 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:53.635517 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-f084286b-ef12-4742-b456-7991f2bcad41 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:53.635517 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-f084286b-ef12-4742-b456-7991f2bcad41 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:53.642399 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f084286b-ef12-4742-b456-7991f2bcad41 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:53.642399 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f084286b-ef12-4742-b456-7991f2bcad41 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:53.644449 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f084286b-ef12-4742-b456-7991f2bcad41 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:53.644449 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f084286b-ef12-4742-b456-7991f2bcad41 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:53.918766 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-f084286b-ef12-4742-b456-7991f2bcad41 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:53.928721 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-f084286b-ef12-4742-b456-7991f2bcad41 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:53.930405 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-f084286b-ef12-4742-b456-7991f2bcad41 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:53.931638 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-f084286b-ef12-4742-b456-7991f2bcad41 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1754 microversion: 2.20 time: 0.301138 Jan 24 09:20:53.932317 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 343/675] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:20:53 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1754 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:20:54.186892 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [req-9745da53-f187-4a8c-a85f-e88037f29a62 req-9831b19c-6fd9-4933-a33f-a1152d19c331 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b0c5b63-d2d9-4dbd-b01d-845151d57d74", "name": "network-vif-deleted", "tag": "37794bd0-f89a-4e6a-8e1c-c7c7ab98e3c5"}]} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:20:54.188529 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:20:54.188529 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: warnings.warn(msg) Jan 24 09:20:54.196720 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-9745da53-f187-4a8c-a85f-e88037f29a62 req-9831b19c-6fd9-4933-a33f-a1152d19c331 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:54.197158 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-9745da53-f187-4a8c-a85f-e88037f29a62 req-9831b19c-6fd9-4933-a33f-a1152d19c331 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:54.206054 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-405b0329-6099-4fdf-b795-7191a6de9224 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:54.206695 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-405b0329-6099-4fdf-b795-7191a6de9224 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:54.214280 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-405b0329-6099-4fdf-b795-7191a6de9224 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:54.215387 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-405b0329-6099-4fdf-b795-7191a6de9224 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:54.217139 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-405b0329-6099-4fdf-b795-7191a6de9224 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:54.217865 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-405b0329-6099-4fdf-b795-7191a6de9224 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:54.219978 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.compute.server_external_events [req-9745da53-f187-4a8c-a85f-e88037f29a62 req-9831b19c-6fd9-4933-a33f-a1152d19c331 service nova] Creating event network-vif-deleted:37794bd0-f89a-4e6a-8e1c-c7c7ab98e3c5 for instance 6b0c5b63-d2d9-4dbd-b01d-845151d57d74 on hv-cinder-80403 Jan 24 09:20:54.225456 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [req-9745da53-f187-4a8c-a85f-e88037f29a62 req-9831b19c-6fd9-4933-a33f-a1152d19c331 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042052 Jan 24 09:20:54.226742 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 333/676] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:20:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:20:54.374493 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-405b0329-6099-4fdf-b795-7191a6de9224 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:54.383914 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-405b0329-6099-4fdf-b795-7191a6de9224 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1565 microversion: 2.1 time: 0.181367 Jan 24 09:20:54.384497 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 344/677] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:54 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1565 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:54.452950 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-7a4835e4-e1c8-4d10-9318-345f451d2a3b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:54.459385 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-7a4835e4-e1c8-4d10-9318-345f451d2a3b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 6b0c5b63-d2d9-4dbd-b01d-845151d57d74] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:54.467240 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-3a50d048-ccd5-4cfd-ba1d-f725d10f79e3 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:54.467453 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-7a4835e4-e1c8-4d10-9318-345f451d2a3b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:54.467873 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-7a4835e4-e1c8-4d10-9318-345f451d2a3b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:54.468134 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-3a50d048-ccd5-4cfd-ba1d-f725d10f79e3 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:54.468670 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-7a4835e4-e1c8-4d10-9318-345f451d2a3b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:54.469236 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-7a4835e4-e1c8-4d10-9318-345f451d2a3b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:54.476954 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3a50d048-ccd5-4cfd-ba1d-f725d10f79e3 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:54.477969 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3a50d048-ccd5-4cfd-ba1d-f725d10f79e3 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:54.478961 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3a50d048-ccd5-4cfd-ba1d-f725d10f79e3 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:54.479564 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3a50d048-ccd5-4cfd-ba1d-f725d10f79e3 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:54.533129 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-7a4835e4-e1c8-4d10-9318-345f451d2a3b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:54.542497 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-7a4835e4-e1c8-4d10-9318-345f451d2a3b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/6b0c5b63-d2d9-4dbd-b01d-845151d57d74" status: 200 len: 1306 microversion: 2.1 time: 0.095019 Jan 24 09:20:54.544736 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 334/678] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:54 2022] GET /compute/v2.1/servers/6b0c5b63-d2d9-4dbd-b01d-845151d57d74 => generated 1306 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:54.558089 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-381212ad-921d-49f0-a91e-62930f74adb6 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:54.559437 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-381212ad-921d-49f0-a91e-62930f74adb6 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f31eba5c-d268-48b8-8d66-c1da93154cc4] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:54.570545 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-381212ad-921d-49f0-a91e-62930f74adb6 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:54.571083 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-381212ad-921d-49f0-a91e-62930f74adb6 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:54.572092 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-381212ad-921d-49f0-a91e-62930f74adb6 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:54.572714 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-381212ad-921d-49f0-a91e-62930f74adb6 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:54.583476 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.objects.instance [None req-3a50d048-ccd5-4cfd-ba1d-f725d10f79e3 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lazy-loading 'services' on Instance uuid 047cd9d3-84f2-4cb0-a2ff-1439420b4f84 {{(pid=116863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 09:20:54.731706 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-381212ad-921d-49f0-a91e-62930f74adb6 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:54.740294 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-381212ad-921d-49f0-a91e-62930f74adb6 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4" status: 200 len: 1269 microversion: 2.1 time: 0.195887 Jan 24 09:20:54.741217 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 335/679] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:54 2022] GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4 => generated 1269 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:54.845186 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-3a50d048-ccd5-4cfd-ba1d-f725d10f79e3 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "DELETE /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84/os-volume_attachments/30bdf825-81d0-458d-8a06-ca5e9985b57e" status: 202 len: 0 microversion: 2.1 time: 0.381438 Jan 24 09:20:54.846016 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 345/680] 10.222.0.113 () {58 vars in 1420 bytes} [Mon Jan 24 09:20:54 2022] DELETE /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84/os-volume_attachments/30bdf825-81d0-458d-8a06-ca5e9985b57e => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 24 09:20:54.855449 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-3cf80154-461f-4806-baa7-a1f000cec263 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:54.856670 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-3cf80154-461f-4806-baa7-a1f000cec263 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:54.862580 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3cf80154-461f-4806-baa7-a1f000cec263 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:54.863028 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3cf80154-461f-4806-baa7-a1f000cec263 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:54.864660 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3cf80154-461f-4806-baa7-a1f000cec263 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:54.865102 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3cf80154-461f-4806-baa7-a1f000cec263 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:54.896551 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-3cf80154-461f-4806-baa7-a1f000cec263 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044847 Jan 24 09:20:54.897106 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 336/681] 10.222.0.113 () {58 vars in 1306 bytes} [Mon Jan 24 09:20:54 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:20:54.952085 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-14d15689-4636-4625-9d45-206c8fd78eb8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:54.953239 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-14d15689-4636-4625-9d45-206c8fd78eb8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:54.960781 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-14d15689-4636-4625-9d45-206c8fd78eb8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:54.961410 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-14d15689-4636-4625-9d45-206c8fd78eb8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:54.962241 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-14d15689-4636-4625-9d45-206c8fd78eb8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:54.962672 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-14d15689-4636-4625-9d45-206c8fd78eb8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:55.130186 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-14d15689-4636-4625-9d45-206c8fd78eb8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:55.139986 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-14d15689-4636-4625-9d45-206c8fd78eb8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:55.141401 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-14d15689-4636-4625-9d45-206c8fd78eb8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:55.142593 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-14d15689-4636-4625-9d45-206c8fd78eb8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1756 microversion: 2.20 time: 0.195653 Jan 24 09:20:55.143159 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 346/682] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:20:54 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1756 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:20:55.554606 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [req-08b42ad9-2069-40f7-9bd1-9c579cce3fea req-7b9c2e39-ce9a-426c-a957-af3f04c36e12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f31eba5c-d268-48b8-8d66-c1da93154cc4", "name": "network-vif-plugged", "status": "completed", "tag": "6ecce77c-24a9-465d-84b4-0e5e56ded4dd"}]} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:20:55.556130 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:20:55.556130 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: warnings.warn(msg) Jan 24 09:20:55.560278 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-775fe35f-b9d9-4c27-bf1f-b7e59dbd2d43 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:55.563667 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-775fe35f-b9d9-4c27-bf1f-b7e59dbd2d43 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 6b0c5b63-d2d9-4dbd-b01d-845151d57d74] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:55.565674 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-08b42ad9-2069-40f7-9bd1-9c579cce3fea req-7b9c2e39-ce9a-426c-a957-af3f04c36e12 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:55.566356 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-08b42ad9-2069-40f7-9bd1-9c579cce3fea req-7b9c2e39-ce9a-426c-a957-af3f04c36e12 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:55.568471 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-775fe35f-b9d9-4c27-bf1f-b7e59dbd2d43 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:55.569087 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-775fe35f-b9d9-4c27-bf1f-b7e59dbd2d43 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:55.570018 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-775fe35f-b9d9-4c27-bf1f-b7e59dbd2d43 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:55.570551 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-775fe35f-b9d9-4c27-bf1f-b7e59dbd2d43 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:55.579411 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.compute.server_external_events [req-08b42ad9-2069-40f7-9bd1-9c579cce3fea req-7b9c2e39-ce9a-426c-a957-af3f04c36e12 service nova] Creating event network-vif-plugged:6ecce77c-24a9-465d-84b4-0e5e56ded4dd for instance f31eba5c-d268-48b8-8d66-c1da93154cc4 on hv-cinder-80403 Jan 24 09:20:55.585082 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.wsgi [None req-775fe35f-b9d9-4c27-bf1f-b7e59dbd2d43 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] HTTP exception thrown: Instance 6b0c5b63-d2d9-4dbd-b01d-845151d57d74 could not be found. Jan 24 09:20:55.585582 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [req-08b42ad9-2069-40f7-9bd1-9c579cce3fea req-7b9c2e39-ce9a-426c-a957-af3f04c36e12 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035280 Jan 24 09:20:55.586219 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-775fe35f-b9d9-4c27-bf1f-b7e59dbd2d43 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Returning 404 to user: Instance 6b0c5b63-d2d9-4dbd-b01d-845151d57d74 could not be found. {{(pid=116863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:20:55.586750 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 337/683] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 09:20:55.587056 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-775fe35f-b9d9-4c27-bf1f-b7e59dbd2d43 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/6b0c5b63-d2d9-4dbd-b01d-845151d57d74" status: 404 len: 111 microversion: 2.1 time: 0.030795 Jan 24 09:20:55.592545 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 347/684] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:55 2022] GET /compute/v2.1/servers/6b0c5b63-d2d9-4dbd-b01d-845151d57d74 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 09:20:55.759009 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-54a32400-6a0b-4782-aa18-d9f32a61658e tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:55.760143 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-54a32400-6a0b-4782-aa18-d9f32a61658e tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f31eba5c-d268-48b8-8d66-c1da93154cc4] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:55.768260 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-54a32400-6a0b-4782-aa18-d9f32a61658e tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:55.768881 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-54a32400-6a0b-4782-aa18-d9f32a61658e tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:55.770365 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-54a32400-6a0b-4782-aa18-d9f32a61658e tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:55.771059 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-54a32400-6a0b-4782-aa18-d9f32a61658e tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:55.911944 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-a7dd28cc-8553-4e0d-930a-b08897f67828 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:55.913196 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-a7dd28cc-8553-4e0d-930a-b08897f67828 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:55.923022 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a7dd28cc-8553-4e0d-930a-b08897f67828 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:55.924184 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a7dd28cc-8553-4e0d-930a-b08897f67828 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:55.925496 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a7dd28cc-8553-4e0d-930a-b08897f67828 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:55.926927 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a7dd28cc-8553-4e0d-930a-b08897f67828 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:55.979023 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-54a32400-6a0b-4782-aa18-d9f32a61658e tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:55.988071 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-a7dd28cc-8553-4e0d-930a-b08897f67828 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081926 Jan 24 09:20:55.995935 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 348/685] 10.222.0.113 () {58 vars in 1306 bytes} [Mon Jan 24 09:20:55 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:20:56.007181 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-54a32400-6a0b-4782-aa18-d9f32a61658e tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4" status: 200 len: 1269 microversion: 2.1 time: 0.252816 Jan 24 09:20:56.008259 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 338/686] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:55 2022] GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4 => generated 1269 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:20:56.166795 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-b6922fc4-ee55-4d34-9f89-3b0a36000a54 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:56.167406 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-b6922fc4-ee55-4d34-9f89-3b0a36000a54 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:56.173363 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b6922fc4-ee55-4d34-9f89-3b0a36000a54 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:56.173989 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b6922fc4-ee55-4d34-9f89-3b0a36000a54 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:56.174836 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b6922fc4-ee55-4d34-9f89-3b0a36000a54 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:56.175277 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b6922fc4-ee55-4d34-9f89-3b0a36000a54 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:56.327605 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-b6922fc4-ee55-4d34-9f89-3b0a36000a54 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:56.337844 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-b6922fc4-ee55-4d34-9f89-3b0a36000a54 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:56.339384 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-b6922fc4-ee55-4d34-9f89-3b0a36000a54 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:56.340631 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-b6922fc4-ee55-4d34-9f89-3b0a36000a54 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1756 microversion: 2.20 time: 0.177642 Jan 24 09:20:56.341458 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 349/687] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:20:56 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:20:56.953131 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-ed5f6811-eea1-4b24-aa16-1769b3d7154e tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:56.954356 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-ed5f6811-eea1-4b24-aa16-1769b3d7154e tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 334e86b7-8556-46c7-aad6-e5b2af845691] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:56.972633 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ed5f6811-eea1-4b24-aa16-1769b3d7154e tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:56.972633 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ed5f6811-eea1-4b24-aa16-1769b3d7154e tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:56.972633 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ed5f6811-eea1-4b24-aa16-1769b3d7154e tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:56.972633 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ed5f6811-eea1-4b24-aa16-1769b3d7154e tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:56.991208 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-ed5f6811-eea1-4b24-aa16-1769b3d7154e tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 334e86b7-8556-46c7-aad6-e5b2af845691] Going to try to terminate instance {{(pid=116864) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 09:20:57.007635 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-cddedcb6-d3e8-44d7-89f0-dbd9d6a3327c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:57.009286 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-cddedcb6-d3e8-44d7-89f0-dbd9d6a3327c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:57.026703 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-cddedcb6-d3e8-44d7-89f0-dbd9d6a3327c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:57.027229 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-cddedcb6-d3e8-44d7-89f0-dbd9d6a3327c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:57.028037 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-cddedcb6-d3e8-44d7-89f0-dbd9d6a3327c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:57.028480 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-cddedcb6-d3e8-44d7-89f0-dbd9d6a3327c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:57.064893 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-cddedcb6-d3e8-44d7-89f0-dbd9d6a3327c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065007 Jan 24 09:20:57.065465 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 350/688] 10.222.0.113 () {58 vars in 1306 bytes} [Mon Jan 24 09:20:56 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:20:57.071026 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-52e3cbe5-78ba-43dd-8b9e-4b18ade5ff3f tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:57.071632 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-52e3cbe5-78ba-43dd-8b9e-4b18ade5ff3f tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f31eba5c-d268-48b8-8d66-c1da93154cc4] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:57.078014 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-52e3cbe5-78ba-43dd-8b9e-4b18ade5ff3f tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:57.078765 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-52e3cbe5-78ba-43dd-8b9e-4b18ade5ff3f tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:57.079554 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-52e3cbe5-78ba-43dd-8b9e-4b18ade5ff3f tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:57.079993 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-52e3cbe5-78ba-43dd-8b9e-4b18ade5ff3f tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:57.280489 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-ed5f6811-eea1-4b24-aa16-1769b3d7154e tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "DELETE /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691" status: 204 len: 0 microversion: 2.1 time: 0.330604 Jan 24 09:20:57.281108 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 339/689] 10.222.0.113 () {58 vars in 1243 bytes} [Mon Jan 24 09:20:56 2022] DELETE /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 24 09:20:57.289501 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-458dc487-fa6c-46a8-bf33-094e57308ae5 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:57.290226 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-458dc487-fa6c-46a8-bf33-094e57308ae5 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 334e86b7-8556-46c7-aad6-e5b2af845691] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:57.296519 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-458dc487-fa6c-46a8-bf33-094e57308ae5 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:57.296942 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-458dc487-fa6c-46a8-bf33-094e57308ae5 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:57.297728 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-458dc487-fa6c-46a8-bf33-094e57308ae5 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:57.298201 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-458dc487-fa6c-46a8-bf33-094e57308ae5 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:57.317547 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-52e3cbe5-78ba-43dd-8b9e-4b18ade5ff3f tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:57.325240 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-52e3cbe5-78ba-43dd-8b9e-4b18ade5ff3f tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4" status: 200 len: 1269 microversion: 2.1 time: 0.258552 Jan 24 09:20:57.325816 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 351/690] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:57 2022] GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4 => generated 1269 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:57.366779 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-a2cf88a3-a772-4c29-9db2-7591e6ccb44b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:57.368256 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-a2cf88a3-a772-4c29-9db2-7591e6ccb44b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:57.381621 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a2cf88a3-a772-4c29-9db2-7591e6ccb44b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:57.382720 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a2cf88a3-a772-4c29-9db2-7591e6ccb44b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:57.384174 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a2cf88a3-a772-4c29-9db2-7591e6ccb44b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:57.385201 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a2cf88a3-a772-4c29-9db2-7591e6ccb44b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:57.466887 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-458dc487-fa6c-46a8-bf33-094e57308ae5 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:57.478899 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-458dc487-fa6c-46a8-bf33-094e57308ae5 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691" status: 200 len: 1518 microversion: 2.1 time: 0.193081 Jan 24 09:20:57.479637 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 340/691] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:57 2022] GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691 => generated 1518 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:20:57.636892 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-a2cf88a3-a772-4c29-9db2-7591e6ccb44b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:57.646974 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-a2cf88a3-a772-4c29-9db2-7591e6ccb44b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:57.650453 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-a2cf88a3-a772-4c29-9db2-7591e6ccb44b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:57.652036 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-a2cf88a3-a772-4c29-9db2-7591e6ccb44b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1812 microversion: 2.20 time: 0.293634 Jan 24 09:20:57.652845 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 352/692] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:20:57 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1812 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:20:58.078162 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-2e8cbba1-b65c-4d8c-8212-f51f1f4bbe51 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:58.078984 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-2e8cbba1-b65c-4d8c-8212-f51f1f4bbe51 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:58.086533 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2e8cbba1-b65c-4d8c-8212-f51f1f4bbe51 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:58.086991 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2e8cbba1-b65c-4d8c-8212-f51f1f4bbe51 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:58.087904 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2e8cbba1-b65c-4d8c-8212-f51f1f4bbe51 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:58.088235 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2e8cbba1-b65c-4d8c-8212-f51f1f4bbe51 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:58.120214 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-2e8cbba1-b65c-4d8c-8212-f51f1f4bbe51 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045954 Jan 24 09:20:58.120797 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 341/693] 10.222.0.113 () {58 vars in 1306 bytes} [Mon Jan 24 09:20:58 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 24 09:20:58.342816 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-bea0b53d-068d-46c8-8401-a3d58d6e7170 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:58.343432 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-bea0b53d-068d-46c8-8401-a3d58d6e7170 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f31eba5c-d268-48b8-8d66-c1da93154cc4] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:58.356071 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bea0b53d-068d-46c8-8401-a3d58d6e7170 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:58.356524 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bea0b53d-068d-46c8-8401-a3d58d6e7170 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:58.357325 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bea0b53d-068d-46c8-8401-a3d58d6e7170 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:58.360388 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bea0b53d-068d-46c8-8401-a3d58d6e7170 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:58.501048 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-7fcfbe09-7665-4c49-b0f8-16dda6fe85a3 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:58.502528 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-7fcfbe09-7665-4c49-b0f8-16dda6fe85a3 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 334e86b7-8556-46c7-aad6-e5b2af845691] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:58.517214 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-7fcfbe09-7665-4c49-b0f8-16dda6fe85a3 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:58.518471 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-7fcfbe09-7665-4c49-b0f8-16dda6fe85a3 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:58.520144 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-7fcfbe09-7665-4c49-b0f8-16dda6fe85a3 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:58.521177 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-7fcfbe09-7665-4c49-b0f8-16dda6fe85a3 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:58.583340 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-bea0b53d-068d-46c8-8401-a3d58d6e7170 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:58.595770 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-bea0b53d-068d-46c8-8401-a3d58d6e7170 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4" status: 200 len: 1456 microversion: 2.1 time: 0.256261 Jan 24 09:20:58.603858 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 353/694] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:58 2022] GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4 => generated 1456 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:58.627945 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-6e9c51a1-f951-4741-8040-c5b335741236 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:58.629176 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-6e9c51a1-f951-4741-8040-c5b335741236 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f31eba5c-d268-48b8-8d66-c1da93154cc4] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:58.650322 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6e9c51a1-f951-4741-8040-c5b335741236 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:58.651259 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6e9c51a1-f951-4741-8040-c5b335741236 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:58.653252 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6e9c51a1-f951-4741-8040-c5b335741236 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:58.654068 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6e9c51a1-f951-4741-8040-c5b335741236 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:58.838474 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-7fcfbe09-7665-4c49-b0f8-16dda6fe85a3 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:58.848489 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-7fcfbe09-7665-4c49-b0f8-16dda6fe85a3 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691" status: 200 len: 1518 microversion: 2.1 time: 0.355120 Jan 24 09:20:58.858466 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 342/695] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:58 2022] GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691 => generated 1518 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:20:58.858466 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-3f56ccb7-5660-407e-855f-1f325750828b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:58.858466 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-3f56ccb7-5660-407e-855f-1f325750828b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:58.867830 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3f56ccb7-5660-407e-855f-1f325750828b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:58.868428 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3f56ccb7-5660-407e-855f-1f325750828b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:58.869355 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3f56ccb7-5660-407e-855f-1f325750828b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:58.870302 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3f56ccb7-5660-407e-855f-1f325750828b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:58.928367 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-6e9c51a1-f951-4741-8040-c5b335741236 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:58.940712 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-6e9c51a1-f951-4741-8040-c5b335741236 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4" status: 200 len: 1456 microversion: 2.1 time: 0.317063 Jan 24 09:20:58.954214 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 354/696] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:58 2022] GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4 => generated 1456 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:20:59.094701 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-3f56ccb7-5660-407e-855f-1f325750828b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:59.112610 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-3f56ccb7-5660-407e-855f-1f325750828b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:59.115544 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-3f56ccb7-5660-407e-855f-1f325750828b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:20:59.117897 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-3f56ccb7-5660-407e-855f-1f325750828b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1812 microversion: 2.20 time: 0.266732 Jan 24 09:20:59.129297 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 343/697] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:20:58 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1812 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:20:59.869167 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-98c91863-ee2d-4131-9d80-1ab35e8e52b5 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:20:59.870920 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-98c91863-ee2d-4131-9d80-1ab35e8e52b5 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 334e86b7-8556-46c7-aad6-e5b2af845691] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:20:59.888206 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-98c91863-ee2d-4131-9d80-1ab35e8e52b5 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:59.888206 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-98c91863-ee2d-4131-9d80-1ab35e8e52b5 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:20:59.888206 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-98c91863-ee2d-4131-9d80-1ab35e8e52b5 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:20:59.888206 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-98c91863-ee2d-4131-9d80-1ab35e8e52b5 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:00.078168 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-98c91863-ee2d-4131-9d80-1ab35e8e52b5 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:00.088994 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-98c91863-ee2d-4131-9d80-1ab35e8e52b5 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691" status: 200 len: 1518 microversion: 2.1 time: 0.227087 Jan 24 09:21:00.102906 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 355/698] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:20:59 2022] GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691 => generated 1518 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:21:00.137128 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-468bc7cc-d7b3-4726-81a4-2772b0598bda tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:00.138793 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-468bc7cc-d7b3-4726-81a4-2772b0598bda tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:00.148724 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-468bc7cc-d7b3-4726-81a4-2772b0598bda tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:00.150662 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-468bc7cc-d7b3-4726-81a4-2772b0598bda tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:00.151784 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-468bc7cc-d7b3-4726-81a4-2772b0598bda tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:00.152457 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-468bc7cc-d7b3-4726-81a4-2772b0598bda tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:00.483075 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-468bc7cc-d7b3-4726-81a4-2772b0598bda tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:00.493130 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-468bc7cc-d7b3-4726-81a4-2772b0598bda tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:00.495440 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-468bc7cc-d7b3-4726-81a4-2772b0598bda tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:00.497442 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-468bc7cc-d7b3-4726-81a4-2772b0598bda tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1812 microversion: 2.20 time: 0.364285 Jan 24 09:21:00.499346 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 344/699] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:21:00 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1812 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:21:00.928651 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-9669359a-89d8-4680-bfa7-eed1e120acb5 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:00.929267 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-9669359a-89d8-4680-bfa7-eed1e120acb5 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:00.936364 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9669359a-89d8-4680-bfa7-eed1e120acb5 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:00.937222 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9669359a-89d8-4680-bfa7-eed1e120acb5 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:00.938475 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9669359a-89d8-4680-bfa7-eed1e120acb5 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:00.939184 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9669359a-89d8-4680-bfa7-eed1e120acb5 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:00.986577 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-9669359a-89d8-4680-bfa7-eed1e120acb5 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Going to try to terminate instance {{(pid=116863) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 09:21:01.107255 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-72b7457c-e3bc-4bc1-9fb5-be2c38b30681 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:01.107875 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-72b7457c-e3bc-4bc1-9fb5-be2c38b30681 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 334e86b7-8556-46c7-aad6-e5b2af845691] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:01.123029 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-72b7457c-e3bc-4bc1-9fb5-be2c38b30681 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:01.124474 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-72b7457c-e3bc-4bc1-9fb5-be2c38b30681 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:01.125832 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-72b7457c-e3bc-4bc1-9fb5-be2c38b30681 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:01.126685 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-72b7457c-e3bc-4bc1-9fb5-be2c38b30681 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:01.351292 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-72b7457c-e3bc-4bc1-9fb5-be2c38b30681 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:01.359616 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-72b7457c-e3bc-4bc1-9fb5-be2c38b30681 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691" status: 200 len: 1518 microversion: 2.1 time: 0.256025 Jan 24 09:21:01.360168 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 345/700] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:21:01 2022] GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691 => generated 1518 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:21:01.519242 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-da72b5da-e266-4d49-8cc9-380c11ea3e73 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:01.521047 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-da72b5da-e266-4d49-8cc9-380c11ea3e73 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:01.533475 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-da72b5da-e266-4d49-8cc9-380c11ea3e73 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:01.534524 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-da72b5da-e266-4d49-8cc9-380c11ea3e73 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:01.536337 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-da72b5da-e266-4d49-8cc9-380c11ea3e73 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:01.536776 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-da72b5da-e266-4d49-8cc9-380c11ea3e73 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:01.851930 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-9669359a-89d8-4680-bfa7-eed1e120acb5 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "DELETE /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 204 len: 0 microversion: 2.1 time: 0.926063 Jan 24 09:21:01.853699 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 356/701] 10.222.0.113 () {58 vars in 1243 bytes} [Mon Jan 24 09:21:00 2022] DELETE /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 0 bytes in 930 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 24 09:21:01.866829 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-cc8610ff-b19d-4ce6-a99f-030a5626a674 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:01.867803 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-cc8610ff-b19d-4ce6-a99f-030a5626a674 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:01.884186 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-cc8610ff-b19d-4ce6-a99f-030a5626a674 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:01.884949 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-cc8610ff-b19d-4ce6-a99f-030a5626a674 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:01.886278 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-cc8610ff-b19d-4ce6-a99f-030a5626a674 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:01.886947 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-cc8610ff-b19d-4ce6-a99f-030a5626a674 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:01.910807 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-da72b5da-e266-4d49-8cc9-380c11ea3e73 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:01.935621 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-da72b5da-e266-4d49-8cc9-380c11ea3e73 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:01.937154 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-da72b5da-e266-4d49-8cc9-380c11ea3e73 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:01.938577 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-da72b5da-e266-4d49-8cc9-380c11ea3e73 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1812 microversion: 2.20 time: 0.423159 Jan 24 09:21:01.952401 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 346/702] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:21:01 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1812 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 09:21:02.164269 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-cc8610ff-b19d-4ce6-a99f-030a5626a674 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:02.174125 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-cc8610ff-b19d-4ce6-a99f-030a5626a674 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1511 microversion: 2.1 time: 0.315081 Jan 24 09:21:02.178774 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 357/703] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:21:01 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1511 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:21:02.385585 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-0ff6b591-3ae0-4586-956f-c48010bc468c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:02.390609 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-0ff6b591-3ae0-4586-956f-c48010bc468c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 334e86b7-8556-46c7-aad6-e5b2af845691] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:02.400822 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0ff6b591-3ae0-4586-956f-c48010bc468c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:02.402206 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0ff6b591-3ae0-4586-956f-c48010bc468c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:02.402206 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0ff6b591-3ae0-4586-956f-c48010bc468c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:02.402716 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0ff6b591-3ae0-4586-956f-c48010bc468c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:02.590636 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [req-cc2442dd-0066-4383-8fd8-1b1152797236 req-258ac11c-1220-4050-bc52-009b46a53b17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f31eba5c-d268-48b8-8d66-c1da93154cc4", "tag": "6ecce77c-24a9-465d-84b4-0e5e56ded4dd"}]} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:21:02.592343 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:21:02.592343 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: warnings.warn(msg) Jan 24 09:21:02.607668 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-cc2442dd-0066-4383-8fd8-1b1152797236 req-258ac11c-1220-4050-bc52-009b46a53b17 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:02.608118 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-cc2442dd-0066-4383-8fd8-1b1152797236 req-258ac11c-1220-4050-bc52-009b46a53b17 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:02.641043 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.compute.server_external_events [req-cc2442dd-0066-4383-8fd8-1b1152797236 req-258ac11c-1220-4050-bc52-009b46a53b17 service nova] Creating event network-changed:6ecce77c-24a9-465d-84b4-0e5e56ded4dd for instance f31eba5c-d268-48b8-8d66-c1da93154cc4 on hv-cinder-80403 Jan 24 09:21:02.653128 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [req-cc2442dd-0066-4383-8fd8-1b1152797236 req-258ac11c-1220-4050-bc52-009b46a53b17 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066463 Jan 24 09:21:02.654801 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 358/704] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 09:21:02.686601 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-0ff6b591-3ae0-4586-956f-c48010bc468c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:02.698028 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-0ff6b591-3ae0-4586-956f-c48010bc468c tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691" status: 200 len: 1518 microversion: 2.1 time: 0.320568 Jan 24 09:21:02.699018 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 347/705] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:21:02 2022] GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691 => generated 1518 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:21:02.964297 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-76360865-1ea1-47c2-8bb2-6f4679156166 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:02.965493 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-76360865-1ea1-47c2-8bb2-6f4679156166 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:02.974143 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-76360865-1ea1-47c2-8bb2-6f4679156166 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:02.975080 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-76360865-1ea1-47c2-8bb2-6f4679156166 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:02.976325 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-76360865-1ea1-47c2-8bb2-6f4679156166 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:02.976992 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-76360865-1ea1-47c2-8bb2-6f4679156166 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:03.196671 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-0926024b-076e-4e51-834f-cfe112c75f16 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:03.197395 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-0926024b-076e-4e51-834f-cfe112c75f16 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:03.210891 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0926024b-076e-4e51-834f-cfe112c75f16 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:03.218916 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0926024b-076e-4e51-834f-cfe112c75f16 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:03.221738 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0926024b-076e-4e51-834f-cfe112c75f16 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:03.223346 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0926024b-076e-4e51-834f-cfe112c75f16 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:03.233301 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-76360865-1ea1-47c2-8bb2-6f4679156166 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:03.248484 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-76360865-1ea1-47c2-8bb2-6f4679156166 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:03.250578 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-76360865-1ea1-47c2-8bb2-6f4679156166 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:03.263865 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-76360865-1ea1-47c2-8bb2-6f4679156166 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1812 microversion: 2.20 time: 0.306054 Jan 24 09:21:03.267688 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 359/706] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:21:02 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1812 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:21:03.500681 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-0926024b-076e-4e51-834f-cfe112c75f16 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:03.511285 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-0926024b-076e-4e51-834f-cfe112c75f16 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1511 microversion: 2.1 time: 0.319474 Jan 24 09:21:03.529995 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 348/707] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:21:03 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1511 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:21:03.717253 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-d285ac6f-35ff-445f-95cc-9e092881fd44 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:03.717957 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-d285ac6f-35ff-445f-95cc-9e092881fd44 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 334e86b7-8556-46c7-aad6-e5b2af845691] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:03.724924 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d285ac6f-35ff-445f-95cc-9e092881fd44 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:03.725622 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d285ac6f-35ff-445f-95cc-9e092881fd44 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:03.727530 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d285ac6f-35ff-445f-95cc-9e092881fd44 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:03.728043 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d285ac6f-35ff-445f-95cc-9e092881fd44 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:03.945210 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-d285ac6f-35ff-445f-95cc-9e092881fd44 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:03.954245 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-d285ac6f-35ff-445f-95cc-9e092881fd44 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691" status: 200 len: 1518 microversion: 2.1 time: 0.240557 Jan 24 09:21:03.955651 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 360/708] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:21:03 2022] GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691 => generated 1518 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:21:04.291122 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-c4122b55-a1b8-43db-a9c9-001ffb9582fa tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:04.292815 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-c4122b55-a1b8-43db-a9c9-001ffb9582fa tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:04.301175 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c4122b55-a1b8-43db-a9c9-001ffb9582fa tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:04.301682 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c4122b55-a1b8-43db-a9c9-001ffb9582fa tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:04.302547 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c4122b55-a1b8-43db-a9c9-001ffb9582fa tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:04.302988 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c4122b55-a1b8-43db-a9c9-001ffb9582fa tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:04.463168 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-c4122b55-a1b8-43db-a9c9-001ffb9582fa tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:04.472979 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-c4122b55-a1b8-43db-a9c9-001ffb9582fa tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:04.474859 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-c4122b55-a1b8-43db-a9c9-001ffb9582fa tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:04.476296 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-c4122b55-a1b8-43db-a9c9-001ffb9582fa tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1812 microversion: 2.20 time: 0.194198 Jan 24 09:21:04.477144 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 349/709] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:21:04 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1812 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:21:04.534637 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-e3230c13-d768-4e96-b38b-24f1fa5a1f0f tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:04.535388 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-e3230c13-d768-4e96-b38b-24f1fa5a1f0f tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:04.542248 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e3230c13-d768-4e96-b38b-24f1fa5a1f0f tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:04.542696 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e3230c13-d768-4e96-b38b-24f1fa5a1f0f tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:04.543492 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e3230c13-d768-4e96-b38b-24f1fa5a1f0f tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:04.543926 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e3230c13-d768-4e96-b38b-24f1fa5a1f0f tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:04.695200 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-e3230c13-d768-4e96-b38b-24f1fa5a1f0f tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:04.704151 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-e3230c13-d768-4e96-b38b-24f1fa5a1f0f tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1511 microversion: 2.1 time: 0.173202 Jan 24 09:21:04.704940 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 361/710] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:21:04 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1511 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:21:04.972412 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-a1801039-9326-463a-a76f-8e94d4d1d105 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:04.973703 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-a1801039-9326-463a-a76f-8e94d4d1d105 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 334e86b7-8556-46c7-aad6-e5b2af845691] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:04.981033 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a1801039-9326-463a-a76f-8e94d4d1d105 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:04.981564 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a1801039-9326-463a-a76f-8e94d4d1d105 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:04.982549 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a1801039-9326-463a-a76f-8e94d4d1d105 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:04.982991 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a1801039-9326-463a-a76f-8e94d4d1d105 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:05.146545 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-a1801039-9326-463a-a76f-8e94d4d1d105 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:05.155135 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-a1801039-9326-463a-a76f-8e94d4d1d105 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691" status: 200 len: 1518 microversion: 2.1 time: 0.186390 Jan 24 09:21:05.155909 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 350/711] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:21:04 2022] GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691 => generated 1518 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:21:05.496125 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-b8d640d0-9837-42cb-ab8a-2b6fb076ac49 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:05.496751 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-b8d640d0-9837-42cb-ab8a-2b6fb076ac49 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:05.503242 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b8d640d0-9837-42cb-ab8a-2b6fb076ac49 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:05.503723 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b8d640d0-9837-42cb-ab8a-2b6fb076ac49 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:05.504513 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b8d640d0-9837-42cb-ab8a-2b6fb076ac49 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:05.504952 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b8d640d0-9837-42cb-ab8a-2b6fb076ac49 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:05.674855 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-b8d640d0-9837-42cb-ab8a-2b6fb076ac49 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:05.684745 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-b8d640d0-9837-42cb-ab8a-2b6fb076ac49 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:05.686305 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-b8d640d0-9837-42cb-ab8a-2b6fb076ac49 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:05.687523 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-b8d640d0-9837-42cb-ab8a-2b6fb076ac49 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1812 microversion: 2.20 time: 0.195453 Jan 24 09:21:05.688401 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 362/712] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:21:05 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1812 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:21:05.722065 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-bac3d00e-e4cb-4ebf-985f-062634ed4347 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:05.723517 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-bac3d00e-e4cb-4ebf-985f-062634ed4347 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:05.729525 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-bac3d00e-e4cb-4ebf-985f-062634ed4347 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:05.729977 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-bac3d00e-e4cb-4ebf-985f-062634ed4347 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:05.730803 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-bac3d00e-e4cb-4ebf-985f-062634ed4347 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:05.731242 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-bac3d00e-e4cb-4ebf-985f-062634ed4347 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:06.104521 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-bac3d00e-e4cb-4ebf-985f-062634ed4347 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:06.112654 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-bac3d00e-e4cb-4ebf-985f-062634ed4347 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1511 microversion: 2.1 time: 0.394187 Jan 24 09:21:06.121822 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 351/713] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:21:05 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1511 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:21:06.172597 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-b9036a61-83bd-47f9-8a0c-5c37417af4ea tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:06.173563 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-b9036a61-83bd-47f9-8a0c-5c37417af4ea tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 334e86b7-8556-46c7-aad6-e5b2af845691] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:06.180985 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b9036a61-83bd-47f9-8a0c-5c37417af4ea tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:06.181733 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b9036a61-83bd-47f9-8a0c-5c37417af4ea tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:06.182755 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b9036a61-83bd-47f9-8a0c-5c37417af4ea tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:06.183268 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b9036a61-83bd-47f9-8a0c-5c37417af4ea tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:06.338976 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-b9036a61-83bd-47f9-8a0c-5c37417af4ea tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:06.346797 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-b9036a61-83bd-47f9-8a0c-5c37417af4ea tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691" status: 200 len: 1518 microversion: 2.1 time: 0.177820 Jan 24 09:21:06.347918 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 363/714] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:21:06 2022] GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691 => generated 1518 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:21:06.706492 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-75cde607-7cb4-423b-bde9-6b38fc3a2863 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:06.707017 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-75cde607-7cb4-423b-bde9-6b38fc3a2863 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:06.713624 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-75cde607-7cb4-423b-bde9-6b38fc3a2863 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:06.714073 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-75cde607-7cb4-423b-bde9-6b38fc3a2863 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:06.714888 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-75cde607-7cb4-423b-bde9-6b38fc3a2863 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:06.715322 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-75cde607-7cb4-423b-bde9-6b38fc3a2863 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:06.887913 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-75cde607-7cb4-423b-bde9-6b38fc3a2863 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:06.897535 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-75cde607-7cb4-423b-bde9-6b38fc3a2863 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:06.899157 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-75cde607-7cb4-423b-bde9-6b38fc3a2863 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:06.900343 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-75cde607-7cb4-423b-bde9-6b38fc3a2863 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1812 microversion: 2.20 time: 0.197692 Jan 24 09:21:06.900923 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 352/715] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:21:06 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1812 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:21:07.131374 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-887ce868-32c6-458d-bac9-879d46b536da tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:07.132384 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-887ce868-32c6-458d-bac9-879d46b536da tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:07.138849 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-887ce868-32c6-458d-bac9-879d46b536da tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:07.139287 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-887ce868-32c6-458d-bac9-879d46b536da tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:07.140069 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-887ce868-32c6-458d-bac9-879d46b536da tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:07.140499 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-887ce868-32c6-458d-bac9-879d46b536da tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:07.275114 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-887ce868-32c6-458d-bac9-879d46b536da tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:07.282458 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-887ce868-32c6-458d-bac9-879d46b536da tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1511 microversion: 2.1 time: 0.155844 Jan 24 09:21:07.283031 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 364/716] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:21:07 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:21:07.364733 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-1677cb1a-e8e8-42fd-97a4-2c9cabfa49dc tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:07.365380 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-1677cb1a-e8e8-42fd-97a4-2c9cabfa49dc tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 334e86b7-8556-46c7-aad6-e5b2af845691] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:07.372392 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1677cb1a-e8e8-42fd-97a4-2c9cabfa49dc tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:07.372879 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1677cb1a-e8e8-42fd-97a4-2c9cabfa49dc tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:07.373662 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1677cb1a-e8e8-42fd-97a4-2c9cabfa49dc tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:07.374133 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1677cb1a-e8e8-42fd-97a4-2c9cabfa49dc tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:07.511334 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-1677cb1a-e8e8-42fd-97a4-2c9cabfa49dc tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:07.519038 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-1677cb1a-e8e8-42fd-97a4-2c9cabfa49dc tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691" status: 200 len: 1518 microversion: 2.1 time: 0.158834 Jan 24 09:21:07.520018 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 353/717] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:21:07 2022] GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691 => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:21:07.918492 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-800b9b5b-8cd3-4b3a-a208-9da2ccdb7a31 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:07.919098 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-800b9b5b-8cd3-4b3a-a208-9da2ccdb7a31 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:07.932108 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-800b9b5b-8cd3-4b3a-a208-9da2ccdb7a31 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:07.932552 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-800b9b5b-8cd3-4b3a-a208-9da2ccdb7a31 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:07.933347 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-800b9b5b-8cd3-4b3a-a208-9da2ccdb7a31 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:07.933778 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-800b9b5b-8cd3-4b3a-a208-9da2ccdb7a31 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:08.124483 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-800b9b5b-8cd3-4b3a-a208-9da2ccdb7a31 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:08.133788 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-800b9b5b-8cd3-4b3a-a208-9da2ccdb7a31 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:08.135450 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-800b9b5b-8cd3-4b3a-a208-9da2ccdb7a31 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:08.136479 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-800b9b5b-8cd3-4b3a-a208-9da2ccdb7a31 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1812 microversion: 2.20 time: 0.221917 Jan 24 09:21:08.137051 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 365/718] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:21:07 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1812 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:21:08.301048 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-4a559165-e643-40cb-a9ff-7562a5aaf694 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:08.301678 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-4a559165-e643-40cb-a9ff-7562a5aaf694 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:08.308435 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4a559165-e643-40cb-a9ff-7562a5aaf694 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:08.308827 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4a559165-e643-40cb-a9ff-7562a5aaf694 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:08.309623 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4a559165-e643-40cb-a9ff-7562a5aaf694 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:08.310060 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4a559165-e643-40cb-a9ff-7562a5aaf694 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:08.447922 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-4a559165-e643-40cb-a9ff-7562a5aaf694 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:08.456043 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-4a559165-e643-40cb-a9ff-7562a5aaf694 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1511 microversion: 2.1 time: 0.160499 Jan 24 09:21:08.456639 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 354/719] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:21:08 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:21:08.536841 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-54a63f2e-899f-4e01-915d-d7df3654171b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:08.537448 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-54a63f2e-899f-4e01-915d-d7df3654171b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 334e86b7-8556-46c7-aad6-e5b2af845691] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:08.543896 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-54a63f2e-899f-4e01-915d-d7df3654171b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:08.544340 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-54a63f2e-899f-4e01-915d-d7df3654171b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:08.545114 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-54a63f2e-899f-4e01-915d-d7df3654171b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:08.545544 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-54a63f2e-899f-4e01-915d-d7df3654171b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:08.679039 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-54a63f2e-899f-4e01-915d-d7df3654171b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:08.686713 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-54a63f2e-899f-4e01-915d-d7df3654171b tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691" status: 200 len: 1518 microversion: 2.1 time: 0.154118 Jan 24 09:21:08.687302 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 366/720] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:21:08 2022] GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:21:09.155267 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-cbe39503-a557-4804-b951-ef56a029c9bb tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:09.155940 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-cbe39503-a557-4804-b951-ef56a029c9bb tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:09.162503 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-cbe39503-a557-4804-b951-ef56a029c9bb tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:09.162953 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-cbe39503-a557-4804-b951-ef56a029c9bb tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:09.163757 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-cbe39503-a557-4804-b951-ef56a029c9bb tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:09.164199 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-cbe39503-a557-4804-b951-ef56a029c9bb tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:09.298290 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-cbe39503-a557-4804-b951-ef56a029c9bb tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:09.306811 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-cbe39503-a557-4804-b951-ef56a029c9bb tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:09.308293 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-cbe39503-a557-4804-b951-ef56a029c9bb tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:09.309444 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-cbe39503-a557-4804-b951-ef56a029c9bb tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1812 microversion: 2.20 time: 0.158052 Jan 24 09:21:09.310015 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 355/721] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:21:09 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1812 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 09:21:09.415684 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [req-b614fd86-f6cd-40f2-a229-90aadef0ab2a req-74268197-c94c-45bd-a1a3-1388f966aac7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "334e86b7-8556-46c7-aad6-e5b2af845691", "name": "network-vif-deleted", "tag": "9d784b74-8dec-426c-928f-bed55e1f51fe"}]} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:21:09.417268 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:21:09.417268 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: warnings.warn(msg) Jan 24 09:21:09.424611 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-b614fd86-f6cd-40f2-a229-90aadef0ab2a req-74268197-c94c-45bd-a1a3-1388f966aac7 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:09.425092 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-b614fd86-f6cd-40f2-a229-90aadef0ab2a req-74268197-c94c-45bd-a1a3-1388f966aac7 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:09.437204 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.compute.server_external_events [req-b614fd86-f6cd-40f2-a229-90aadef0ab2a req-74268197-c94c-45bd-a1a3-1388f966aac7 service nova] Creating event network-vif-deleted:9d784b74-8dec-426c-928f-bed55e1f51fe for instance 334e86b7-8556-46c7-aad6-e5b2af845691 on hv-cinder-80403 Jan 24 09:21:09.443740 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [req-b614fd86-f6cd-40f2-a229-90aadef0ab2a req-74268197-c94c-45bd-a1a3-1388f966aac7 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031601 Jan 24 09:21:09.444346 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 367/722] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:21:09.474452 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-f1e06082-176d-4787-8c87-ff2ec919eaba tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:09.475428 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-f1e06082-176d-4787-8c87-ff2ec919eaba tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:09.484402 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f1e06082-176d-4787-8c87-ff2ec919eaba tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:09.490421 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f1e06082-176d-4787-8c87-ff2ec919eaba tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:09.490421 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f1e06082-176d-4787-8c87-ff2ec919eaba tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:09.490421 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f1e06082-176d-4787-8c87-ff2ec919eaba tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:09.625020 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-f1e06082-176d-4787-8c87-ff2ec919eaba tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:09.633419 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-f1e06082-176d-4787-8c87-ff2ec919eaba tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1511 microversion: 2.1 time: 0.164290 Jan 24 09:21:09.634004 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 356/723] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:21:09 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1511 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:21:09.704682 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-af18d21e-2862-4514-93c7-22d4cd660882 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:09.705168 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-af18d21e-2862-4514-93c7-22d4cd660882 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 334e86b7-8556-46c7-aad6-e5b2af845691] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:09.711864 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-af18d21e-2862-4514-93c7-22d4cd660882 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:09.712304 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-af18d21e-2862-4514-93c7-22d4cd660882 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:09.713119 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-af18d21e-2862-4514-93c7-22d4cd660882 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:09.713548 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-af18d21e-2862-4514-93c7-22d4cd660882 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:09.775440 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-af18d21e-2862-4514-93c7-22d4cd660882 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:09.782713 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-af18d21e-2862-4514-93c7-22d4cd660882 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691" status: 200 len: 1307 microversion: 2.1 time: 0.082257 Jan 24 09:21:09.783284 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 368/724] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:21:09 2022] GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691 => generated 1307 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:21:10.328439 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-a7ebf0e2-75fb-4751-97b4-86349848c294 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:10.329048 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-a7ebf0e2-75fb-4751-97b4-86349848c294 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:10.336620 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a7ebf0e2-75fb-4751-97b4-86349848c294 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:10.337069 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a7ebf0e2-75fb-4751-97b4-86349848c294 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:10.337862 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a7ebf0e2-75fb-4751-97b4-86349848c294 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:10.338346 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a7ebf0e2-75fb-4751-97b4-86349848c294 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:10.475260 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-a7ebf0e2-75fb-4751-97b4-86349848c294 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:10.483513 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-a7ebf0e2-75fb-4751-97b4-86349848c294 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:10.485050 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-a7ebf0e2-75fb-4751-97b4-86349848c294 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:10.486221 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-a7ebf0e2-75fb-4751-97b4-86349848c294 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1812 microversion: 2.20 time: 0.161528 Jan 24 09:21:10.486782 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 357/725] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:21:10 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1812 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:21:10.650599 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-cc4da0ec-2838-4ad4-9d62-cb7a65a13420 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:10.651133 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-cc4da0ec-2838-4ad4-9d62-cb7a65a13420 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:10.657385 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-cc4da0ec-2838-4ad4-9d62-cb7a65a13420 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:10.657893 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-cc4da0ec-2838-4ad4-9d62-cb7a65a13420 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:10.658754 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-cc4da0ec-2838-4ad4-9d62-cb7a65a13420 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:10.659282 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-cc4da0ec-2838-4ad4-9d62-cb7a65a13420 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:10.796999 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-cc4da0ec-2838-4ad4-9d62-cb7a65a13420 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:10.802733 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-fc3d14b3-6930-49c2-bafa-a0f626ef53b2 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:10.803539 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-fc3d14b3-6930-49c2-bafa-a0f626ef53b2 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 334e86b7-8556-46c7-aad6-e5b2af845691] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:10.807590 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-cc4da0ec-2838-4ad4-9d62-cb7a65a13420 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1511 microversion: 2.1 time: 0.160614 Jan 24 09:21:10.808293 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 369/726] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:21:10 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:21:10.809322 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fc3d14b3-6930-49c2-bafa-a0f626ef53b2 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:10.809852 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fc3d14b3-6930-49c2-bafa-a0f626ef53b2 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:10.810687 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fc3d14b3-6930-49c2-bafa-a0f626ef53b2 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:10.811129 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fc3d14b3-6930-49c2-bafa-a0f626ef53b2 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:10.844320 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fc3d14b3-6930-49c2-bafa-a0f626ef53b2 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:10.844763 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fc3d14b3-6930-49c2-bafa-a0f626ef53b2 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:10.845209 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.objects.instance [None req-fc3d14b3-6930-49c2-bafa-a0f626ef53b2 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lazy-loading 'fault' on Instance uuid 334e86b7-8556-46c7-aad6-e5b2af845691 {{(pid=116864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 09:21:10.883561 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-fc3d14b3-6930-49c2-bafa-a0f626ef53b2 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d33f34357f4132b712dff54a6446f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effc220352541ecba9f319db87235de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:10.891646 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-fc3d14b3-6930-49c2-bafa-a0f626ef53b2 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691" status: 200 len: 1312 microversion: 2.1 time: 0.092563 Jan 24 09:21:10.892272 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 358/727] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:21:10 2022] GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691 => generated 1312 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:21:11.505169 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-c4e0be95-5cf9-4cdd-a7d3-b46e46e5f3bf tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:11.505873 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-c4e0be95-5cf9-4cdd-a7d3-b46e46e5f3bf tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:11.511734 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c4e0be95-5cf9-4cdd-a7d3-b46e46e5f3bf tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:11.512185 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c4e0be95-5cf9-4cdd-a7d3-b46e46e5f3bf tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:11.512976 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c4e0be95-5cf9-4cdd-a7d3-b46e46e5f3bf tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:11.513409 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c4e0be95-5cf9-4cdd-a7d3-b46e46e5f3bf tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:11.830065 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-166aeb48-dd96-48b8-b8d8-c4916d5c1b2c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:11.830786 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-166aeb48-dd96-48b8-b8d8-c4916d5c1b2c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:11.838162 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-166aeb48-dd96-48b8-b8d8-c4916d5c1b2c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:11.838625 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-166aeb48-dd96-48b8-b8d8-c4916d5c1b2c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:11.839439 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-166aeb48-dd96-48b8-b8d8-c4916d5c1b2c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:11.839884 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-166aeb48-dd96-48b8-b8d8-c4916d5c1b2c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:11.964463 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-c4e0be95-5cf9-4cdd-a7d3-b46e46e5f3bf tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:11.974334 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-c4e0be95-5cf9-4cdd-a7d3-b46e46e5f3bf tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:11.975954 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-c4e0be95-5cf9-4cdd-a7d3-b46e46e5f3bf tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:11.977249 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-c4e0be95-5cf9-4cdd-a7d3-b46e46e5f3bf tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1812 microversion: 2.20 time: 0.476317 Jan 24 09:21:11.982488 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 370/728] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:21:11 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1812 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:21:11.982488 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-34cdd33d-3fbb-41c0-8c0d-2a3533f1c473 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:11.982893 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-34cdd33d-3fbb-41c0-8c0d-2a3533f1c473 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] [instance: 334e86b7-8556-46c7-aad6-e5b2af845691] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:11.989510 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-34cdd33d-3fbb-41c0-8c0d-2a3533f1c473 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:11.990056 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-34cdd33d-3fbb-41c0-8c0d-2a3533f1c473 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:11.990979 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-34cdd33d-3fbb-41c0-8c0d-2a3533f1c473 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:11.991491 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-34cdd33d-3fbb-41c0-8c0d-2a3533f1c473 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:11.996293 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-166aeb48-dd96-48b8-b8d8-c4916d5c1b2c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:12.004099 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-166aeb48-dd96-48b8-b8d8-c4916d5c1b2c tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1511 microversion: 2.1 time: 0.177753 Jan 24 09:21:12.007771 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 359/729] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:21:11 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1511 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:21:12.007890 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.wsgi [None req-34cdd33d-3fbb-41c0-8c0d-2a3533f1c473 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] HTTP exception thrown: Instance 334e86b7-8556-46c7-aad6-e5b2af845691 could not be found. Jan 24 09:21:12.007890 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-34cdd33d-3fbb-41c0-8c0d-2a3533f1c473 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] Returning 404 to user: Instance 334e86b7-8556-46c7-aad6-e5b2af845691 could not be found. {{(pid=116863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:21:12.007890 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-34cdd33d-3fbb-41c0-8c0d-2a3533f1c473 tempest-AttachVolumeNegativeTest-1390692965 tempest-AttachVolumeNegativeTest-1390692965-project] 10.222.0.113 "GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691" status: 404 len: 111 microversion: 2.1 time: 0.028207 Jan 24 09:21:12.007890 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 371/730] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:21:11 2022] GET /compute/v2.1/servers/334e86b7-8556-46c7-aad6-e5b2af845691 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 09:21:12.302728 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [req-271c37fc-b665-4618-b38e-b517ada6456c req-d888c5c6-9cc6-4dfd-9c30-45f9e7d1c3dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c90c156b-e532-4c87-b23c-3d4326e991bd", "name": "network-vif-deleted", "tag": "5e0c4cdf-09d8-44d6-8bce-e6c6ed362462"}]} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:21:12.304958 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:21:12.304958 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: warnings.warn(msg) Jan 24 09:21:12.312757 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-271c37fc-b665-4618-b38e-b517ada6456c req-d888c5c6-9cc6-4dfd-9c30-45f9e7d1c3dd service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:12.313343 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-271c37fc-b665-4618-b38e-b517ada6456c req-d888c5c6-9cc6-4dfd-9c30-45f9e7d1c3dd service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:12.325803 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.compute.server_external_events [req-271c37fc-b665-4618-b38e-b517ada6456c req-d888c5c6-9cc6-4dfd-9c30-45f9e7d1c3dd service nova] Creating event network-vif-deleted:5e0c4cdf-09d8-44d6-8bce-e6c6ed362462 for instance c90c156b-e532-4c87-b23c-3d4326e991bd on hv-cinder-80403 Jan 24 09:21:12.331135 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [req-271c37fc-b665-4618-b38e-b517ada6456c req-d888c5c6-9cc6-4dfd-9c30-45f9e7d1c3dd service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035076 Jan 24 09:21:12.333391 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 360/731] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:21:12.996250 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-68898b36-699a-41b0-9508-ac2ceae9ad6c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:13.002992 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-68898b36-699a-41b0-9508-ac2ceae9ad6c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:13.003159 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-68898b36-699a-41b0-9508-ac2ceae9ad6c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:13.003662 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-68898b36-699a-41b0-9508-ac2ceae9ad6c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:13.004411 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-68898b36-699a-41b0-9508-ac2ceae9ad6c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:13.004852 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-68898b36-699a-41b0-9508-ac2ceae9ad6c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:13.023981 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-ce9bbb54-7a76-4e54-9ecf-026acdfcb02b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:13.026648 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-ce9bbb54-7a76-4e54-9ecf-026acdfcb02b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:13.031355 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ce9bbb54-7a76-4e54-9ecf-026acdfcb02b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:13.031805 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ce9bbb54-7a76-4e54-9ecf-026acdfcb02b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:13.032793 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ce9bbb54-7a76-4e54-9ecf-026acdfcb02b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:13.033239 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ce9bbb54-7a76-4e54-9ecf-026acdfcb02b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:13.068783 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ce9bbb54-7a76-4e54-9ecf-026acdfcb02b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:13.069322 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ce9bbb54-7a76-4e54-9ecf-026acdfcb02b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:13.069905 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.objects.instance [None req-ce9bbb54-7a76-4e54-9ecf-026acdfcb02b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lazy-loading 'fault' on Instance uuid c90c156b-e532-4c87-b23c-3d4326e991bd {{(pid=116864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 09:21:13.115685 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-ce9bbb54-7a76-4e54-9ecf-026acdfcb02b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:13.123359 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-ce9bbb54-7a76-4e54-9ecf-026acdfcb02b tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 200 len: 1315 microversion: 2.1 time: 0.103743 Jan 24 09:21:13.123947 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 361/732] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:21:13 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 1315 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:21:13.148954 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-68898b36-699a-41b0-9508-ac2ceae9ad6c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:13.157913 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-68898b36-699a-41b0-9508-ac2ceae9ad6c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:13.159606 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-68898b36-699a-41b0-9508-ac2ceae9ad6c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:13.161398 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-68898b36-699a-41b0-9508-ac2ceae9ad6c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1812 microversion: 2.20 time: 0.168844 Jan 24 09:21:13.161961 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 372/733] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:21:12 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1812 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:21:14.141706 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-8978b7c8-ed53-44aa-bd25-a38a7c8daa50 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:14.143016 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-8978b7c8-ed53-44aa-bd25-a38a7c8daa50 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: c90c156b-e532-4c87-b23c-3d4326e991bd] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:14.149224 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-8978b7c8-ed53-44aa-bd25-a38a7c8daa50 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:14.149736 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-8978b7c8-ed53-44aa-bd25-a38a7c8daa50 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:14.150546 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-8978b7c8-ed53-44aa-bd25-a38a7c8daa50 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:14.150984 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-8978b7c8-ed53-44aa-bd25-a38a7c8daa50 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:14.164528 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.wsgi [None req-8978b7c8-ed53-44aa-bd25-a38a7c8daa50 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] HTTP exception thrown: Instance c90c156b-e532-4c87-b23c-3d4326e991bd could not be found. Jan 24 09:21:14.165305 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-8978b7c8-ed53-44aa-bd25-a38a7c8daa50 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Returning 404 to user: Instance c90c156b-e532-4c87-b23c-3d4326e991bd could not be found. {{(pid=116864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:21:14.165954 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-8978b7c8-ed53-44aa-bd25-a38a7c8daa50 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd" status: 404 len: 111 microversion: 2.1 time: 0.029150 Jan 24 09:21:14.166547 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 362/734] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:21:14 2022] GET /compute/v2.1/servers/c90c156b-e532-4c87-b23c-3d4326e991bd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 09:21:14.176251 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-ea7b8458-0ac1-46a2-9f34-01975426bcd2 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:14.176897 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-ea7b8458-0ac1-46a2-9f34-01975426bcd2 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:14.179604 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-491e8408-18c2-4f8b-96b7-4d24ef550f1b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:14.180241 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-491e8408-18c2-4f8b-96b7-4d24ef550f1b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:14.183407 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ea7b8458-0ac1-46a2-9f34-01975426bcd2 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:14.183860 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ea7b8458-0ac1-46a2-9f34-01975426bcd2 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:14.184652 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ea7b8458-0ac1-46a2-9f34-01975426bcd2 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:14.185133 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ea7b8458-0ac1-46a2-9f34-01975426bcd2 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:14.188126 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-491e8408-18c2-4f8b-96b7-4d24ef550f1b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:14.188703 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-491e8408-18c2-4f8b-96b7-4d24ef550f1b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:14.189527 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-491e8408-18c2-4f8b-96b7-4d24ef550f1b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:14.190002 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-491e8408-18c2-4f8b-96b7-4d24ef550f1b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:14.212600 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-ea7b8458-0ac1-46a2-9f34-01975426bcd2 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Going to try to terminate instance {{(pid=116863) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 09:21:14.331973 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-491e8408-18c2-4f8b-96b7-4d24ef550f1b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:14.340371 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-491e8408-18c2-4f8b-96b7-4d24ef550f1b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:14.341879 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-491e8408-18c2-4f8b-96b7-4d24ef550f1b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:14.343073 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-491e8408-18c2-4f8b-96b7-4d24ef550f1b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1812 microversion: 2.20 time: 0.168087 Jan 24 09:21:14.343687 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 363/735] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:21:14 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1812 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 09:21:14.582732 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-ea7b8458-0ac1-46a2-9f34-01975426bcd2 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "DELETE /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 204 len: 0 microversion: 2.1 time: 0.410620 Jan 24 09:21:14.583325 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 373/736] 10.222.0.113 () {58 vars in 1243 bytes} [Mon Jan 24 09:21:14 2022] DELETE /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 24 09:21:14.591273 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-89f86681-404b-4a4a-8144-41091c1a0d2e tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:14.592057 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-89f86681-404b-4a4a-8144-41091c1a0d2e tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:14.598546 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-89f86681-404b-4a4a-8144-41091c1a0d2e tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:14.598997 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-89f86681-404b-4a4a-8144-41091c1a0d2e tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:14.599781 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-89f86681-404b-4a4a-8144-41091c1a0d2e tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:14.600220 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-89f86681-404b-4a4a-8144-41091c1a0d2e tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:14.736648 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-89f86681-404b-4a4a-8144-41091c1a0d2e tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:14.744236 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-89f86681-404b-4a4a-8144-41091c1a0d2e tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1525 microversion: 2.1 time: 0.156543 Jan 24 09:21:14.744818 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 364/737] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:21:14 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1525 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:21:14.947798 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-5d984e63-3644-445e-ad53-5fe910f66e8a tempest-VolumesGetTestJSON-174913196 tempest-VolumesGetTestJSON-174913196-project] Action: 'create', calling method: .version_select at 0x7f473dc38280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-682233462", "metadata": {"Type": "work"}}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:21:15.367852 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-ace70cf5-ce2e-4b61-a048-1a03a7ee5bd9 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:15.368652 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-ace70cf5-ce2e-4b61-a048-1a03a7ee5bd9 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:15.378272 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ace70cf5-ce2e-4b61-a048-1a03a7ee5bd9 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:15.379009 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ace70cf5-ce2e-4b61-a048-1a03a7ee5bd9 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:15.380451 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ace70cf5-ce2e-4b61-a048-1a03a7ee5bd9 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:15.380944 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ace70cf5-ce2e-4b61-a048-1a03a7ee5bd9 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:15.526202 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-ace70cf5-ce2e-4b61-a048-1a03a7ee5bd9 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:15.535678 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-ace70cf5-ce2e-4b61-a048-1a03a7ee5bd9 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:15.537308 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-ace70cf5-ce2e-4b61-a048-1a03a7ee5bd9 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:15.538594 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-ace70cf5-ce2e-4b61-a048-1a03a7ee5bd9 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1812 microversion: 2.20 time: 0.176031 Jan 24 09:21:15.539170 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 365/738] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:21:15 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1812 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:21:15.743250 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-5d984e63-3644-445e-ad53-5fe910f66e8a tempest-VolumesGetTestJSON-174913196 tempest-VolumesGetTestJSON-174913196-project] 10.222.0.113 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.923183 Jan 24 09:21:15.744034 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 374/739] 10.222.0.113 () {60 vars in 1160 bytes} [Mon Jan 24 09:21:14 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 925 msecs (HTTP/1.1 200) 10 headers in 449 bytes (1 switches on core 0) Jan 24 09:21:15.762657 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-6c9b485c-7653-4ba5-9fd2-2d61845d7ce6 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:15.763278 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-6c9b485c-7653-4ba5-9fd2-2d61845d7ce6 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:15.765231 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-27a9df90-aa9b-47c3-8eab-fd17a968dca8 tempest-VolumesGetTestJSON-174913196 tempest-VolumesGetTestJSON-174913196-project] Calling method '.version_select at 0x7f473db73940>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:15.769843 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6c9b485c-7653-4ba5-9fd2-2d61845d7ce6 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:15.770344 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6c9b485c-7653-4ba5-9fd2-2d61845d7ce6 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:15.771151 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6c9b485c-7653-4ba5-9fd2-2d61845d7ce6 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:15.771591 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6c9b485c-7653-4ba5-9fd2-2d61845d7ce6 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:15.834885 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-27a9df90-aa9b-47c3-8eab-fd17a968dca8 tempest-VolumesGetTestJSON-174913196 tempest-VolumesGetTestJSON-174913196-project] 10.222.0.113 "GET /compute/v2.1/os-volumes/307de053-3196-4034-8eeb-11d7f76aefa3" status: 200 len: 352 microversion: 2.1 time: 0.073386 Jan 24 09:21:15.835570 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 375/740] 10.222.0.113 () {58 vars in 1249 bytes} [Mon Jan 24 09:21:15 2022] GET /compute/v2.1/os-volumes/307de053-3196-4034-8eeb-11d7f76aefa3 => generated 352 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 09:21:15.960314 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-6c9b485c-7653-4ba5-9fd2-2d61845d7ce6 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:15.968380 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-6c9b485c-7653-4ba5-9fd2-2d61845d7ce6 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1525 microversion: 2.1 time: 0.209718 Jan 24 09:21:15.972205 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 366/741] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:21:15 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1525 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:21:16.557876 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-1c9440c8-00cb-4585-8223-b23cfcd766bd tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:16.558633 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-1c9440c8-00cb-4585-8223-b23cfcd766bd tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:16.564841 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1c9440c8-00cb-4585-8223-b23cfcd766bd tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:16.571895 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1c9440c8-00cb-4585-8223-b23cfcd766bd tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:16.571895 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1c9440c8-00cb-4585-8223-b23cfcd766bd tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:16.571895 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1c9440c8-00cb-4585-8223-b23cfcd766bd tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:16.716287 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-1c9440c8-00cb-4585-8223-b23cfcd766bd tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:16.725930 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-1c9440c8-00cb-4585-8223-b23cfcd766bd tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:16.727533 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-1c9440c8-00cb-4585-8223-b23cfcd766bd tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:16.728694 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-1c9440c8-00cb-4585-8223-b23cfcd766bd tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1812 microversion: 2.20 time: 0.175167 Jan 24 09:21:16.738248 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 376/742] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:21:16 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1812 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:21:16.847705 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-eae20337-8ed1-4576-8db0-4b02bbe02ef3 tempest-VolumesGetTestJSON-174913196 tempest-VolumesGetTestJSON-174913196-project] Calling method '.version_select at 0x7f473d36cca0>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:16.896759 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-eae20337-8ed1-4576-8db0-4b02bbe02ef3 tempest-VolumesGetTestJSON-174913196 tempest-VolumesGetTestJSON-174913196-project] 10.222.0.113 "GET /compute/v2.1/os-volumes/307de053-3196-4034-8eeb-11d7f76aefa3" status: 200 len: 353 microversion: 2.1 time: 0.053151 Jan 24 09:21:16.897795 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 367/743] 10.222.0.113 () {58 vars in 1249 bytes} [Mon Jan 24 09:21:16 2022] GET /compute/v2.1/os-volumes/307de053-3196-4034-8eeb-11d7f76aefa3 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 09:21:16.910451 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-19dd83fb-d7e6-4e3a-94ed-d5b9d90be463 tempest-VolumesGetTestJSON-174913196 tempest-VolumesGetTestJSON-174913196-project] Calling method '.version_select at 0x7f473db4d5e0>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:16.966769 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-19dd83fb-d7e6-4e3a-94ed-d5b9d90be463 tempest-VolumesGetTestJSON-174913196 tempest-VolumesGetTestJSON-174913196-project] 10.222.0.113 "GET /compute/v2.1/os-volumes/307de053-3196-4034-8eeb-11d7f76aefa3" status: 200 len: 353 microversion: 2.1 time: 0.061412 Jan 24 09:21:16.967278 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 377/744] 10.222.0.113 () {58 vars in 1249 bytes} [Mon Jan 24 09:21:16 2022] GET /compute/v2.1/os-volumes/307de053-3196-4034-8eeb-11d7f76aefa3 => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 09:21:16.983299 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-61055665-f700-4d30-8846-cfceb25a9047 tempest-VolumesGetTestJSON-174913196 tempest-VolumesGetTestJSON-174913196-project] Calling method '.version_select at 0x7f473d36caf0>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:16.986579 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-6a961be8-abe6-4a16-a6c7-f7b60c6498a8 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:16.987184 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-6a961be8-abe6-4a16-a6c7-f7b60c6498a8 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:16.997960 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6a961be8-abe6-4a16-a6c7-f7b60c6498a8 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:16.998447 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6a961be8-abe6-4a16-a6c7-f7b60c6498a8 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:16.999485 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6a961be8-abe6-4a16-a6c7-f7b60c6498a8 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:17.000142 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6a961be8-abe6-4a16-a6c7-f7b60c6498a8 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:17.138654 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-6a961be8-abe6-4a16-a6c7-f7b60c6498a8 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:17.146941 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-6a961be8-abe6-4a16-a6c7-f7b60c6498a8 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1525 microversion: 2.1 time: 0.163822 Jan 24 09:21:17.147524 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 378/745] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:21:16 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1525 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:21:17.256160 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-61055665-f700-4d30-8846-cfceb25a9047 tempest-VolumesGetTestJSON-174913196 tempest-VolumesGetTestJSON-174913196-project] 10.222.0.113 "DELETE /compute/v2.1/os-volumes/307de053-3196-4034-8eeb-11d7f76aefa3" status: 202 len: 0 microversion: 2.1 time: 0.276011 Jan 24 09:21:17.256740 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 368/746] 10.222.0.113 () {58 vars in 1252 bytes} [Mon Jan 24 09:21:16 2022] DELETE /compute/v2.1/os-volumes/307de053-3196-4034-8eeb-11d7f76aefa3 => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:21:17.266069 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-b21a51cc-3c6e-4e5a-b645-1d6611837b19 tempest-VolumesGetTestJSON-174913196 tempest-VolumesGetTestJSON-174913196-project] Calling method '.version_select at 0x7f473e700040>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:17.315103 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-b21a51cc-3c6e-4e5a-b645-1d6611837b19 tempest-VolumesGetTestJSON-174913196 tempest-VolumesGetTestJSON-174913196-project] 10.222.0.113 "GET /compute/v2.1/os-volumes/307de053-3196-4034-8eeb-11d7f76aefa3" status: 200 len: 352 microversion: 2.1 time: 0.053843 Jan 24 09:21:17.315714 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 379/747] 10.222.0.113 () {58 vars in 1249 bytes} [Mon Jan 24 09:21:17 2022] GET /compute/v2.1/os-volumes/307de053-3196-4034-8eeb-11d7f76aefa3 => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 09:21:17.747785 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-0956e135-d3ed-436e-872d-74df1b7f20d9 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:17.751422 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-0956e135-d3ed-436e-872d-74df1b7f20d9 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:17.755604 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0956e135-d3ed-436e-872d-74df1b7f20d9 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:17.756049 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0956e135-d3ed-436e-872d-74df1b7f20d9 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:17.756865 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0956e135-d3ed-436e-872d-74df1b7f20d9 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:17.757294 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0956e135-d3ed-436e-872d-74df1b7f20d9 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:17.895168 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-0956e135-d3ed-436e-872d-74df1b7f20d9 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:17.904749 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-0956e135-d3ed-436e-872d-74df1b7f20d9 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:17.906449 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-0956e135-d3ed-436e-872d-74df1b7f20d9 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:17.907624 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-0956e135-d3ed-436e-872d-74df1b7f20d9 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1812 microversion: 2.20 time: 0.163619 Jan 24 09:21:17.908613 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 369/748] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:21:17 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1812 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:21:18.164024 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-431704d8-3138-492b-be6a-17b3b7e437e6 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:18.164636 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-431704d8-3138-492b-be6a-17b3b7e437e6 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:18.173314 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-431704d8-3138-492b-be6a-17b3b7e437e6 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:18.173768 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-431704d8-3138-492b-be6a-17b3b7e437e6 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:18.174587 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-431704d8-3138-492b-be6a-17b3b7e437e6 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:18.175082 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-431704d8-3138-492b-be6a-17b3b7e437e6 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:18.325976 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-431704d8-3138-492b-be6a-17b3b7e437e6 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:18.327346 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-0e591e24-e79f-48da-8c2f-b2514c0eae80 tempest-VolumesGetTestJSON-174913196 tempest-VolumesGetTestJSON-174913196-project] Calling method '.version_select at 0x7f473d31d820>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:18.334222 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-431704d8-3138-492b-be6a-17b3b7e437e6 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1525 microversion: 2.1 time: 0.174580 Jan 24 09:21:18.334922 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 380/749] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:21:18 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1525 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:21:18.361738 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.wsgi [None req-0e591e24-e79f-48da-8c2f-b2514c0eae80 tempest-VolumesGetTestJSON-174913196 tempest-VolumesGetTestJSON-174913196-project] HTTP exception thrown: Volume 307de053-3196-4034-8eeb-11d7f76aefa3 could not be found. Jan 24 09:21:18.362595 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-0e591e24-e79f-48da-8c2f-b2514c0eae80 tempest-VolumesGetTestJSON-174913196 tempest-VolumesGetTestJSON-174913196-project] Returning 404 to user: Volume 307de053-3196-4034-8eeb-11d7f76aefa3 could not be found. {{(pid=116864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:21:18.363757 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-0e591e24-e79f-48da-8c2f-b2514c0eae80 tempest-VolumesGetTestJSON-174913196 tempest-VolumesGetTestJSON-174913196-project] 10.222.0.113 "GET /compute/v2.1/os-volumes/307de053-3196-4034-8eeb-11d7f76aefa3" status: 404 len: 109 microversion: 2.1 time: 0.040179 Jan 24 09:21:18.364307 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 370/750] 10.222.0.113 () {58 vars in 1249 bytes} [Mon Jan 24 09:21:18 2022] GET /compute/v2.1/os-volumes/307de053-3196-4034-8eeb-11d7f76aefa3 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 24 09:21:18.930827 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-67597309-0cbd-411a-95bd-dad79ced84e0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:18.931527 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-67597309-0cbd-411a-95bd-dad79ced84e0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:18.937644 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-67597309-0cbd-411a-95bd-dad79ced84e0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:18.938263 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-67597309-0cbd-411a-95bd-dad79ced84e0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:18.939120 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-67597309-0cbd-411a-95bd-dad79ced84e0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:18.939627 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-67597309-0cbd-411a-95bd-dad79ced84e0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:19.171532 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-67597309-0cbd-411a-95bd-dad79ced84e0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:19.182387 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-67597309-0cbd-411a-95bd-dad79ced84e0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:19.184021 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-67597309-0cbd-411a-95bd-dad79ced84e0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:19.185897 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-67597309-0cbd-411a-95bd-dad79ced84e0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1812 microversion: 2.20 time: 0.262777 Jan 24 09:21:19.186704 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 381/751] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:21:18 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1812 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:21:19.350507 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-c508f5b4-6b41-44d8-bd83-386943476bc6 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:19.353299 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-c508f5b4-6b41-44d8-bd83-386943476bc6 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:19.359691 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c508f5b4-6b41-44d8-bd83-386943476bc6 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:19.360543 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c508f5b4-6b41-44d8-bd83-386943476bc6 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:19.361353 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c508f5b4-6b41-44d8-bd83-386943476bc6 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:19.361841 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c508f5b4-6b41-44d8-bd83-386943476bc6 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:19.502029 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-c508f5b4-6b41-44d8-bd83-386943476bc6 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:19.511507 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-c508f5b4-6b41-44d8-bd83-386943476bc6 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1525 microversion: 2.1 time: 0.165218 Jan 24 09:21:19.516882 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 371/752] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:21:19 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1525 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:21:19.560015 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [req-7d96359a-0366-44ad-bd4a-d277574cf592 req-c7c75303-03c6-474a-b176-c963d3636aa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b820c156-179a-4172-a02b-6c88713087f1", "name": "network-vif-plugged", "status": "completed", "tag": "73ec9bcf-7f40-4fd5-9968-de1accae6f03"}]} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:21:19.562695 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:21:19.562695 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: warnings.warn(msg) Jan 24 09:21:19.568672 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-7d96359a-0366-44ad-bd4a-d277574cf592 req-c7c75303-03c6-474a-b176-c963d3636aa0 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:19.569114 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-7d96359a-0366-44ad-bd4a-d277574cf592 req-c7c75303-03c6-474a-b176-c963d3636aa0 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:19.579797 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.compute.server_external_events [req-7d96359a-0366-44ad-bd4a-d277574cf592 req-c7c75303-03c6-474a-b176-c963d3636aa0 service nova] Creating event network-vif-plugged:73ec9bcf-7f40-4fd5-9968-de1accae6f03 for instance b820c156-179a-4172-a02b-6c88713087f1 on hv-cinder-80403 Jan 24 09:21:19.586867 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [req-7d96359a-0366-44ad-bd4a-d277574cf592 req-c7c75303-03c6-474a-b176-c963d3636aa0 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030461 Jan 24 09:21:19.587461 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 382/753] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:21:20.204688 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-e05e6bd4-5ec4-48a6-b09f-e6f9774349c1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:20.205394 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-e05e6bd4-5ec4-48a6-b09f-e6f9774349c1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:20.214797 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e05e6bd4-5ec4-48a6-b09f-e6f9774349c1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:20.214797 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e05e6bd4-5ec4-48a6-b09f-e6f9774349c1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:20.214797 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e05e6bd4-5ec4-48a6-b09f-e6f9774349c1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:20.214797 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e05e6bd4-5ec4-48a6-b09f-e6f9774349c1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:20.384309 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-e05e6bd4-5ec4-48a6-b09f-e6f9774349c1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:20.392952 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-e05e6bd4-5ec4-48a6-b09f-e6f9774349c1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:20.395081 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-e05e6bd4-5ec4-48a6-b09f-e6f9774349c1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:20.396262 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-e05e6bd4-5ec4-48a6-b09f-e6f9774349c1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1812 microversion: 2.20 time: 0.195572 Jan 24 09:21:20.396825 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 372/754] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:21:20 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1812 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:21:20.529483 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-b3f5dbb0-8e53-4bb2-ad62-e4aad62dc43d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:20.530198 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-b3f5dbb0-8e53-4bb2-ad62-e4aad62dc43d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:20.536764 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b3f5dbb0-8e53-4bb2-ad62-e4aad62dc43d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:20.537204 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b3f5dbb0-8e53-4bb2-ad62-e4aad62dc43d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:20.538000 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b3f5dbb0-8e53-4bb2-ad62-e4aad62dc43d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:20.538439 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b3f5dbb0-8e53-4bb2-ad62-e4aad62dc43d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:20.680900 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-b3f5dbb0-8e53-4bb2-ad62-e4aad62dc43d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:20.688454 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-b3f5dbb0-8e53-4bb2-ad62-e4aad62dc43d tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1525 microversion: 2.1 time: 0.163105 Jan 24 09:21:20.694887 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 383/755] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:21:20 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1525 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:21:21.415100 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-44564b50-ff87-4d63-8b5e-325bf68a2fe0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:21.415795 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-44564b50-ff87-4d63-8b5e-325bf68a2fe0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:21.422271 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-44564b50-ff87-4d63-8b5e-325bf68a2fe0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:21.422978 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-44564b50-ff87-4d63-8b5e-325bf68a2fe0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:21.423754 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-44564b50-ff87-4d63-8b5e-325bf68a2fe0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:21.425336 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-44564b50-ff87-4d63-8b5e-325bf68a2fe0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:21.560744 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-44564b50-ff87-4d63-8b5e-325bf68a2fe0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:21.572460 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-44564b50-ff87-4d63-8b5e-325bf68a2fe0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:21.572460 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-44564b50-ff87-4d63-8b5e-325bf68a2fe0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:21.572908 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-44564b50-ff87-4d63-8b5e-325bf68a2fe0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1812 microversion: 2.20 time: 0.162113 Jan 24 09:21:21.573701 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 373/756] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:21:21 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1812 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:21:21.705869 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-94a5d6a6-b224-464f-80b1-7f023cc30946 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:21.706904 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-94a5d6a6-b224-464f-80b1-7f023cc30946 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:21.714854 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-94a5d6a6-b224-464f-80b1-7f023cc30946 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:21.715383 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-94a5d6a6-b224-464f-80b1-7f023cc30946 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:21.716315 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-94a5d6a6-b224-464f-80b1-7f023cc30946 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:21.716911 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-94a5d6a6-b224-464f-80b1-7f023cc30946 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:21.880871 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-94a5d6a6-b224-464f-80b1-7f023cc30946 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:21.888712 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-94a5d6a6-b224-464f-80b1-7f023cc30946 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1525 microversion: 2.1 time: 0.186485 Jan 24 09:21:21.889296 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 384/757] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:21:21 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1525 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:21:22.591025 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-492cb029-4e52-4647-81b3-09bef5c99afd tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:22.591729 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-492cb029-4e52-4647-81b3-09bef5c99afd tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:22.599106 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-492cb029-4e52-4647-81b3-09bef5c99afd tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:22.599720 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-492cb029-4e52-4647-81b3-09bef5c99afd tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:22.600706 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-492cb029-4e52-4647-81b3-09bef5c99afd tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:22.601263 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-492cb029-4e52-4647-81b3-09bef5c99afd tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:22.751817 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-492cb029-4e52-4647-81b3-09bef5c99afd tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:22.761319 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-492cb029-4e52-4647-81b3-09bef5c99afd tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:22.762904 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-492cb029-4e52-4647-81b3-09bef5c99afd tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:22.764082 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-492cb029-4e52-4647-81b3-09bef5c99afd tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1812 microversion: 2.20 time: 0.177260 Jan 24 09:21:22.764657 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 374/758] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:21:22 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1812 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:21:22.906659 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-c4886f9c-c56d-4ba3-b6d9-069d5572b1eb tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:22.906659 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-c4886f9c-c56d-4ba3-b6d9-069d5572b1eb tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:22.916624 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c4886f9c-c56d-4ba3-b6d9-069d5572b1eb tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:22.916624 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c4886f9c-c56d-4ba3-b6d9-069d5572b1eb tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:22.916624 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c4886f9c-c56d-4ba3-b6d9-069d5572b1eb tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:22.916624 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c4886f9c-c56d-4ba3-b6d9-069d5572b1eb tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:23.151487 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-c4886f9c-c56d-4ba3-b6d9-069d5572b1eb tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:23.160614 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-c4886f9c-c56d-4ba3-b6d9-069d5572b1eb tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1525 microversion: 2.1 time: 0.258606 Jan 24 09:21:23.161207 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 385/759] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:21:22 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1525 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:21:23.464456 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [req-ef96392c-c6da-43e6-ae32-35720db87c5a req-5597ac3d-fbe2-404f-9592-6d82dd668026 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "047cd9d3-84f2-4cb0-a2ff-1439420b4f84", "name": "network-vif-deleted", "tag": "8921ac36-ed44-4666-b756-63bd8f08a955"}]} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:21:23.466063 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:21:23.466063 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: warnings.warn(msg) Jan 24 09:21:23.474859 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-ef96392c-c6da-43e6-ae32-35720db87c5a req-5597ac3d-fbe2-404f-9592-6d82dd668026 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:23.475325 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-ef96392c-c6da-43e6-ae32-35720db87c5a req-5597ac3d-fbe2-404f-9592-6d82dd668026 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:23.485961 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.compute.server_external_events [req-ef96392c-c6da-43e6-ae32-35720db87c5a req-5597ac3d-fbe2-404f-9592-6d82dd668026 service nova] Creating event network-vif-deleted:8921ac36-ed44-4666-b756-63bd8f08a955 for instance 047cd9d3-84f2-4cb0-a2ff-1439420b4f84 on hv-cinder-80403 Jan 24 09:21:23.492133 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [req-ef96392c-c6da-43e6-ae32-35720db87c5a req-5597ac3d-fbe2-404f-9592-6d82dd668026 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031346 Jan 24 09:21:23.492898 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 375/760] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:21:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:21:23.788444 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-a6662766-19b3-40de-9642-d9a4f0c90aaf tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:23.789086 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-a6662766-19b3-40de-9642-d9a4f0c90aaf tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:23.795043 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a6662766-19b3-40de-9642-d9a4f0c90aaf tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:23.795498 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a6662766-19b3-40de-9642-d9a4f0c90aaf tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:23.796286 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a6662766-19b3-40de-9642-d9a4f0c90aaf tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:23.796725 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a6662766-19b3-40de-9642-d9a4f0c90aaf tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:23.927526 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-a6662766-19b3-40de-9642-d9a4f0c90aaf tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:23.936599 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-a6662766-19b3-40de-9642-d9a4f0c90aaf tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:23.938142 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-a6662766-19b3-40de-9642-d9a4f0c90aaf tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:23.939351 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-a6662766-19b3-40de-9642-d9a4f0c90aaf tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1799 microversion: 2.20 time: 0.156891 Jan 24 09:21:23.955794 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 386/761] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:21:23 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1799 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:21:24.180100 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-934500ea-19af-44fe-bb52-98b5a57b1fed tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:24.180959 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-934500ea-19af-44fe-bb52-98b5a57b1fed tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:24.188651 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-934500ea-19af-44fe-bb52-98b5a57b1fed tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:24.189203 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-934500ea-19af-44fe-bb52-98b5a57b1fed tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:24.190754 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-934500ea-19af-44fe-bb52-98b5a57b1fed tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:24.191423 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-934500ea-19af-44fe-bb52-98b5a57b1fed tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:24.224739 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-934500ea-19af-44fe-bb52-98b5a57b1fed tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:24.225189 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-934500ea-19af-44fe-bb52-98b5a57b1fed tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:24.225647 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.objects.instance [None req-934500ea-19af-44fe-bb52-98b5a57b1fed tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lazy-loading 'fault' on Instance uuid 047cd9d3-84f2-4cb0-a2ff-1439420b4f84 {{(pid=116864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 09:21:24.268435 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-934500ea-19af-44fe-bb52-98b5a57b1fed tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354fc57e1b9d49e3ba9102bfe5d76980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6f638b201f414f81bda294a0adce5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:24.275838 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-934500ea-19af-44fe-bb52-98b5a57b1fed tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 200 len: 1314 microversion: 2.1 time: 0.101599 Jan 24 09:21:24.276342 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 376/762] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:21:24 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 1314 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:21:25.295239 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-aeba9dd6-02eb-4de4-9edd-9399b73c64e6 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:25.295774 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-aeba9dd6-02eb-4de4-9edd-9399b73c64e6 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] [instance: 047cd9d3-84f2-4cb0-a2ff-1439420b4f84] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:25.302427 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-aeba9dd6-02eb-4de4-9edd-9399b73c64e6 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:25.302886 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-aeba9dd6-02eb-4de4-9edd-9399b73c64e6 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:25.303668 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-aeba9dd6-02eb-4de4-9edd-9399b73c64e6 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:25.304139 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-aeba9dd6-02eb-4de4-9edd-9399b73c64e6 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:25.317918 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.wsgi [None req-aeba9dd6-02eb-4de4-9edd-9399b73c64e6 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] HTTP exception thrown: Instance 047cd9d3-84f2-4cb0-a2ff-1439420b4f84 could not be found. Jan 24 09:21:25.318550 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-aeba9dd6-02eb-4de4-9edd-9399b73c64e6 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] Returning 404 to user: Instance 047cd9d3-84f2-4cb0-a2ff-1439420b4f84 could not be found. {{(pid=116863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:21:25.319385 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-aeba9dd6-02eb-4de4-9edd-9399b73c64e6 tempest-ServerRescueNegativeTestJSON-1583464503 tempest-ServerRescueNegativeTestJSON-1583464503-project] 10.222.0.113 "GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84" status: 404 len: 111 microversion: 2.1 time: 0.027935 Jan 24 09:21:25.319938 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 387/763] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:21:25 2022] GET /compute/v2.1/servers/047cd9d3-84f2-4cb0-a2ff-1439420b4f84 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 09:21:32.817769 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-70b56463-5d52-473b-9f5e-52b105581a41 tempest-VolumesTestJSON-1688795766 tempest-VolumesTestJSON-1688795766-project] Calling method '.version_select at 0x7f473d37eb80>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:32.868606 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-70b56463-5d52-473b-9f5e-52b105581a41 tempest-VolumesTestJSON-1688795766 tempest-VolumesTestJSON-1688795766-project] 10.222.0.113 "GET /compute/v2.1/os-volumes/52e1de8a-5ce2-436f-a588-f98df40d2ed0" status: 200 len: 350 microversion: 2.1 time: 0.054839 Jan 24 09:21:32.869178 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 377/764] 10.222.0.113 () {58 vars in 1249 bytes} [Mon Jan 24 09:21:32 2022] GET /compute/v2.1/os-volumes/52e1de8a-5ce2-436f-a588-f98df40d2ed0 => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 09:21:34.626298 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-f3360e49-3986-49c2-93e9-24082abd9c04 tempest-VolumesTestJSON-1688795766 tempest-VolumesTestJSON-1688795766-project] Calling method '.version_select at 0x7f473db0f5e0>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:34.679822 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-f3360e49-3986-49c2-93e9-24082abd9c04 tempest-VolumesTestJSON-1688795766 tempest-VolumesTestJSON-1688795766-project] 10.222.0.113 "GET /compute/v2.1/os-volumes/f184631e-5f69-4741-92a7-6811db860e97" status: 200 len: 350 microversion: 2.1 time: 0.057793 Jan 24 09:21:34.680392 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 388/765] 10.222.0.113 () {58 vars in 1249 bytes} [Mon Jan 24 09:21:34 2022] GET /compute/v2.1/os-volumes/f184631e-5f69-4741-92a7-6811db860e97 => generated 350 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:21:36.350526 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-3621bbf3-0e61-4d14-af7f-9111babc49f3 tempest-VolumesTestJSON-1688795766 tempest-VolumesTestJSON-1688795766-project] Calling method '.version_select at 0x7f473d3aa550>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:36.400428 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-3621bbf3-0e61-4d14-af7f-9111babc49f3 tempest-VolumesTestJSON-1688795766 tempest-VolumesTestJSON-1688795766-project] 10.222.0.113 "GET /compute/v2.1/os-volumes/f26b31a1-066c-4e6e-aec9-e35579f83d4a" status: 200 len: 350 microversion: 2.1 time: 0.054755 Jan 24 09:21:36.400949 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 378/766] 10.222.0.113 () {58 vars in 1249 bytes} [Mon Jan 24 09:21:36 2022] GET /compute/v2.1/os-volumes/f26b31a1-066c-4e6e-aec9-e35579f83d4a => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:21:36.412977 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-ef06cb24-7c71-45c5-a078-411b4056ec1b tempest-VolumesTestJSON-1688795766 tempest-VolumesTestJSON-1688795766-project] Calling method '.version_select at 0x7f473daf8430>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:36.500270 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-ef06cb24-7c71-45c5-a078-411b4056ec1b tempest-VolumesTestJSON-1688795766 tempest-VolumesTestJSON-1688795766-project] 10.222.0.113 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.091455 Jan 24 09:21:36.501125 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 389/767] 10.222.0.113 () {58 vars in 1138 bytes} [Mon Jan 24 09:21:36 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:21:36.513237 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-f2bcc79f-dfe3-4517-b340-80d009d7e7a0 tempest-VolumesTestJSON-1688795766 tempest-VolumesTestJSON-1688795766-project] Calling method '.version_select at 0x7f473d38ca60>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:36.625806 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-f2bcc79f-dfe3-4517-b340-80d009d7e7a0 tempest-VolumesTestJSON-1688795766 tempest-VolumesTestJSON-1688795766-project] 10.222.0.113 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.116076 Jan 24 09:21:36.627759 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 379/768] 10.222.0.113 () {58 vars in 1153 bytes} [Mon Jan 24 09:21:36 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:21:36.640286 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-807115dd-ad78-4cab-b94e-86cf7537d4a1 tempest-VolumesTestJSON-1688795766 tempest-VolumesTestJSON-1688795766-project] Calling method '.version_select at 0x7f473daf0550>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:36.726676 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-807115dd-ad78-4cab-b94e-86cf7537d4a1 tempest-VolumesTestJSON-1688795766 tempest-VolumesTestJSON-1688795766-project] 10.222.0.113 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.090318 Jan 24 09:21:36.727390 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 390/769] 10.222.0.113 () {58 vars in 1138 bytes} [Mon Jan 24 09:21:36 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:21:36.739382 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-4fc94aca-aea5-42cd-8022-81e03514bd00 tempest-VolumesTestJSON-1688795766 tempest-VolumesTestJSON-1688795766-project] Calling method '.version_select at 0x7f473d38c8b0>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:36.838633 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-4fc94aca-aea5-42cd-8022-81e03514bd00 tempest-VolumesTestJSON-1688795766 tempest-VolumesTestJSON-1688795766-project] 10.222.0.113 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.103921 Jan 24 09:21:36.839212 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 380/770] 10.222.0.113 () {58 vars in 1171 bytes} [Mon Jan 24 09:21:36 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 09:21:36.851856 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-4f5d4fdd-10a9-4a64-a62a-eeb925147f63 tempest-VolumesTestJSON-1688795766 tempest-VolumesTestJSON-1688795766-project] Calling method '.version_select at 0x7f473dd7d820>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:36.937401 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-4f5d4fdd-10a9-4a64-a62a-eeb925147f63 tempest-VolumesTestJSON-1688795766 tempest-VolumesTestJSON-1688795766-project] 10.222.0.113 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.089163 Jan 24 09:21:36.937984 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 391/771] 10.222.0.113 () {58 vars in 1174 bytes} [Mon Jan 24 09:21:36 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:21:36.950460 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-5cea0ae0-5b9b-4fc3-aa73-71b570992c8f tempest-VolumesTestJSON-1688795766 tempest-VolumesTestJSON-1688795766-project] Calling method '.version_select at 0x7f473d31dc10>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:37.039543 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-5cea0ae0-5b9b-4fc3-aa73-71b570992c8f tempest-VolumesTestJSON-1688795766 tempest-VolumesTestJSON-1688795766-project] 10.222.0.113 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.088456 Jan 24 09:21:37.039543 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 381/772] 10.222.0.113 () {58 vars in 1159 bytes} [Mon Jan 24 09:21:36 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:21:37.052012 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-cdddc12c-84ad-4ec7-8551-d90540872acc tempest-VolumesTestJSON-1688795766 tempest-VolumesTestJSON-1688795766-project] Calling method '.version_select at 0x7f473db30af0>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:37.138696 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-cdddc12c-84ad-4ec7-8551-d90540872acc tempest-VolumesTestJSON-1688795766 tempest-VolumesTestJSON-1688795766-project] 10.222.0.113 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.090303 Jan 24 09:21:37.139212 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 392/773] 10.222.0.113 () {58 vars in 1192 bytes} [Mon Jan 24 09:21:37 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 09:21:37.150925 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-03ce8ad0-e25b-463d-9bcd-17ddbf25912c tempest-VolumesTestJSON-1688795766 tempest-VolumesTestJSON-1688795766-project] Calling method '.version_select at 0x7f473d54ed30>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:37.247100 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-03ce8ad0-e25b-463d-9bcd-17ddbf25912c tempest-VolumesTestJSON-1688795766 tempest-VolumesTestJSON-1688795766-project] 10.222.0.113 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.099552 Jan 24 09:21:37.247936 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 382/774] 10.222.0.113 () {58 vars in 1159 bytes} [Mon Jan 24 09:21:37 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:21:43.449613 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-4df2241b-b7e2-4c30-b550-8fd8f2b864d4 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:43.450142 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-4df2241b-b7e2-4c30-b550-8fd8f2b864d4 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:43.457160 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4df2241b-b7e2-4c30-b550-8fd8f2b864d4 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:43.457600 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4df2241b-b7e2-4c30-b550-8fd8f2b864d4 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:43.458415 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4df2241b-b7e2-4c30-b550-8fd8f2b864d4 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:43.458853 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4df2241b-b7e2-4c30-b550-8fd8f2b864d4 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:43.539795 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.objects.instance [None req-4df2241b-b7e2-4c30-b550-8fd8f2b864d4 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lazy-loading 'services' on Instance uuid c7421454-e5c9-4ecb-8afb-928a7042b789 {{(pid=116863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 09:21:43.882493 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-4df2241b-b7e2-4c30-b550-8fd8f2b864d4 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "DELETE /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/os-volume_attachments/dcc5b842-485e-4c76-82fc-267f65928855" status: 202 len: 0 microversion: 2.1 time: 0.436645 Jan 24 09:21:43.883556 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 393/775] 10.222.0.113 () {58 vars in 1420 bytes} [Mon Jan 24 09:21:43 2022] DELETE /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/os-volume_attachments/dcc5b842-485e-4c76-82fc-267f65928855 => generated 0 bytes in 439 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:21:45.200421 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-6c48bace-7902-4740-bfef-6b2c0049ac18 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:21:45.208408 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6c48bace-7902-4740-bfef-6b2c0049ac18 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:45.208408 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6c48bace-7902-4740-bfef-6b2c0049ac18 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:45.281049 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-6c48bace-7902-4740-bfef-6b2c0049ac18 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Going to try to stop instance {{(pid=116864) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 24 09:21:45.562363 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-6c48bace-7902-4740-bfef-6b2c0049ac18 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 202 len: 0 microversion: 2.1 time: 0.366486 Jan 24 09:21:45.563447 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 383/776] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:21:45 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:21:45.573602 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-9358e210-dabe-42ca-8525-846db2d2dcb2 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:45.574447 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-9358e210-dabe-42ca-8525-846db2d2dcb2 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:45.581171 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9358e210-dabe-42ca-8525-846db2d2dcb2 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:45.581660 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9358e210-dabe-42ca-8525-846db2d2dcb2 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:45.582495 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9358e210-dabe-42ca-8525-846db2d2dcb2 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:45.582930 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9358e210-dabe-42ca-8525-846db2d2dcb2 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:45.723065 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-9358e210-dabe-42ca-8525-846db2d2dcb2 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:45.730545 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-9358e210-dabe-42ca-8525-846db2d2dcb2 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1680 microversion: 2.1 time: 0.161740 Jan 24 09:21:45.731454 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 394/777] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:21:45 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:21:46.750227 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-001d94b9-7bfb-4e7b-b828-a72d8446329d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:46.750887 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-001d94b9-7bfb-4e7b-b828-a72d8446329d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:46.757226 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-001d94b9-7bfb-4e7b-b828-a72d8446329d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:46.757690 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-001d94b9-7bfb-4e7b-b828-a72d8446329d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:46.758590 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-001d94b9-7bfb-4e7b-b828-a72d8446329d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:46.759432 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-001d94b9-7bfb-4e7b-b828-a72d8446329d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:46.904659 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-001d94b9-7bfb-4e7b-b828-a72d8446329d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:46.912335 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-001d94b9-7bfb-4e7b-b828-a72d8446329d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1680 microversion: 2.1 time: 0.167026 Jan 24 09:21:46.912915 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 384/778] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:21:46 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:21:47.930008 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-4008c47f-c2f4-44fb-a866-27a7475d8db8 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:47.930661 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-4008c47f-c2f4-44fb-a866-27a7475d8db8 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:47.943027 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4008c47f-c2f4-44fb-a866-27a7475d8db8 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:47.943396 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4008c47f-c2f4-44fb-a866-27a7475d8db8 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:47.944191 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4008c47f-c2f4-44fb-a866-27a7475d8db8 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:47.945000 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4008c47f-c2f4-44fb-a866-27a7475d8db8 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:48.099696 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-4008c47f-c2f4-44fb-a866-27a7475d8db8 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:48.107133 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-4008c47f-c2f4-44fb-a866-27a7475d8db8 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1680 microversion: 2.1 time: 0.180582 Jan 24 09:21:48.107721 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 395/779] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:21:47 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1680 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:21:49.129589 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-727b80cc-7caf-42f5-9095-be102e23734f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:49.130730 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-727b80cc-7caf-42f5-9095-be102e23734f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:49.142835 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-727b80cc-7caf-42f5-9095-be102e23734f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:49.143897 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-727b80cc-7caf-42f5-9095-be102e23734f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:49.145336 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-727b80cc-7caf-42f5-9095-be102e23734f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:49.146178 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-727b80cc-7caf-42f5-9095-be102e23734f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:49.284913 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-727b80cc-7caf-42f5-9095-be102e23734f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:49.293650 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-727b80cc-7caf-42f5-9095-be102e23734f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1680 microversion: 2.1 time: 0.170791 Jan 24 09:21:49.294600 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 385/780] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:21:49 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:21:50.312211 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-27363dfb-bf6a-44f4-abe1-ed2a60c79693 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:50.313916 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-27363dfb-bf6a-44f4-abe1-ed2a60c79693 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:50.320099 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-27363dfb-bf6a-44f4-abe1-ed2a60c79693 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:50.320542 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-27363dfb-bf6a-44f4-abe1-ed2a60c79693 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:50.321848 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-27363dfb-bf6a-44f4-abe1-ed2a60c79693 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:50.322327 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-27363dfb-bf6a-44f4-abe1-ed2a60c79693 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:50.465838 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-27363dfb-bf6a-44f4-abe1-ed2a60c79693 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:50.474603 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-27363dfb-bf6a-44f4-abe1-ed2a60c79693 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1680 microversion: 2.1 time: 0.166110 Jan 24 09:21:50.475197 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 396/781] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:21:50 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:21:51.497168 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-42bb9e37-1ada-4454-b57b-0c1038d15fa0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:51.497777 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-42bb9e37-1ada-4454-b57b-0c1038d15fa0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:51.505187 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-42bb9e37-1ada-4454-b57b-0c1038d15fa0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:51.505643 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-42bb9e37-1ada-4454-b57b-0c1038d15fa0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:51.506477 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-42bb9e37-1ada-4454-b57b-0c1038d15fa0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:51.506920 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-42bb9e37-1ada-4454-b57b-0c1038d15fa0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:51.645884 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-42bb9e37-1ada-4454-b57b-0c1038d15fa0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:51.653291 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-42bb9e37-1ada-4454-b57b-0c1038d15fa0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1680 microversion: 2.1 time: 0.159978 Jan 24 09:21:51.654261 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 386/782] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:21:51 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:21:52.670797 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-d1ae6d08-f0f3-4ada-9b40-4c88092e293d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:52.671737 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-d1ae6d08-f0f3-4ada-9b40-4c88092e293d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:52.678295 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d1ae6d08-f0f3-4ada-9b40-4c88092e293d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:52.678755 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d1ae6d08-f0f3-4ada-9b40-4c88092e293d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:52.679607 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d1ae6d08-f0f3-4ada-9b40-4c88092e293d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:52.679991 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d1ae6d08-f0f3-4ada-9b40-4c88092e293d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:52.857642 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-d1ae6d08-f0f3-4ada-9b40-4c88092e293d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:52.865863 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-d1ae6d08-f0f3-4ada-9b40-4c88092e293d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1680 microversion: 2.1 time: 0.198715 Jan 24 09:21:52.866846 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 397/783] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:21:52 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1680 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:21:53.884273 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-57799b64-1aa1-4d25-8480-21957d389a75 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:53.884875 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-57799b64-1aa1-4d25-8480-21957d389a75 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:53.891385 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-57799b64-1aa1-4d25-8480-21957d389a75 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:53.891899 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-57799b64-1aa1-4d25-8480-21957d389a75 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:53.892753 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-57799b64-1aa1-4d25-8480-21957d389a75 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:53.893215 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-57799b64-1aa1-4d25-8480-21957d389a75 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:54.026697 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-57799b64-1aa1-4d25-8480-21957d389a75 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:54.034696 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-57799b64-1aa1-4d25-8480-21957d389a75 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1680 microversion: 2.1 time: 0.154097 Jan 24 09:21:54.035274 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 387/784] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:21:53 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:21:55.053344 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-0bd2e7e3-e463-459b-96ab-726f31aa1f46 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:55.053968 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-0bd2e7e3-e463-459b-96ab-726f31aa1f46 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:55.060821 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0bd2e7e3-e463-459b-96ab-726f31aa1f46 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:55.075732 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0bd2e7e3-e463-459b-96ab-726f31aa1f46 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:55.075732 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0bd2e7e3-e463-459b-96ab-726f31aa1f46 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:55.075732 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0bd2e7e3-e463-459b-96ab-726f31aa1f46 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:55.194676 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-0bd2e7e3-e463-459b-96ab-726f31aa1f46 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:55.202179 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-0bd2e7e3-e463-459b-96ab-726f31aa1f46 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1680 microversion: 2.1 time: 0.153857 Jan 24 09:21:55.206897 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 398/785] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:21:55 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:21:55.310745 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-dc3e89b1-bf27-41be-ae31-40fd407630f9 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-421608561", "imageRef": "c527e37f-a381-465e-babe-11528029ed9b", "flavorRef": "452", "networks": [{"uuid": "44105748-356f-448f-a70c-5d65f0a57e7a"}]}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:21:55.366362 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.network.neutron [None req-dc3e89b1-bf27-41be-ae31-40fd407630f9 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] validate_networks() for [('44105748-356f-448f-a70c-5d65f0a57e7a', None, None, None, None, None)] {{(pid=116864) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 09:21:55.710046 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-dc3e89b1-bf27-41be-ae31-40fd407630f9 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Flavor limits 0:0:0 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 09:21:55.710506 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-dc3e89b1-bf27-41be-ae31-40fd407630f9 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Image limits 0:0:0 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 09:21:55.710974 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-dc3e89b1-bf27-41be-ae31-40fd407630f9 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Flavor pref 0:0:0 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 09:21:55.711378 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-dc3e89b1-bf27-41be-ae31-40fd407630f9 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Image pref 0:0:0 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 09:21:55.711787 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-dc3e89b1-bf27-41be-ae31-40fd407630f9 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 09:21:55.720682 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-dc3e89b1-bf27-41be-ae31-40fd407630f9 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:55.721158 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-dc3e89b1-bf27-41be-ae31-40fd407630f9 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:55.721972 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-dc3e89b1-bf27-41be-ae31-40fd407630f9 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:55.722439 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-dc3e89b1-bf27-41be-ae31-40fd407630f9 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:55.738804 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.quota [None req-dc3e89b1-bf27-41be-ae31-40fd407630f9 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Getting quotas for project bc3fa7c12b554a3bbfd918b6de58df20. Resources: {'ram', 'cores', 'instances'} {{(pid=116864) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 09:21:55.742771 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.quota [None req-dc3e89b1-bf27-41be-ae31-40fd407630f9 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Getting quotas for user a041ed923e234b479a07afe629707504 and project bc3fa7c12b554a3bbfd918b6de58df20. Resources: {'ram', 'cores', 'instances'} {{(pid=116864) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 09:21:55.754291 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-dc3e89b1-bf27-41be-ae31-40fd407630f9 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Going to run 1 instances... {{(pid=116864) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 09:21:55.756589 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-dc3e89b1-bf27-41be-ae31-40fd407630f9 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] [instance: bdbfa507-91f3-471e-8723-518082c93741] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c527e37f-a381-465e-babe-11528029ed9b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 09:21:55.951964 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-dc3e89b1-bf27-41be-ae31-40fd407630f9 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.645435 Jan 24 09:21:55.952757 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 388/786] 10.222.0.113 () {60 vars in 1151 bytes} [Mon Jan 24 09:21:55 2022] POST /compute/v2.1/servers => generated 382 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 24 09:21:55.962820 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-21c91139-7c20-4a09-80e1-1f11699b771a tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:55.963432 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-21c91139-7c20-4a09-80e1-1f11699b771a tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] [instance: bdbfa507-91f3-471e-8723-518082c93741] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:56.017972 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-21c91139-7c20-4a09-80e1-1f11699b771a tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a041ed923e234b479a07afe629707504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3fa7c12b554a3bbfd918b6de58df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:56.024523 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-21c91139-7c20-4a09-80e1-1f11699b771a tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] 10.222.0.113 "GET /compute/v2.1/servers/bdbfa507-91f3-471e-8723-518082c93741" status: 200 len: 1217 microversion: 2.1 time: 0.065332 Jan 24 09:21:56.025126 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 399/787] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:21:55 2022] GET /compute/v2.1/servers/bdbfa507-91f3-471e-8723-518082c93741 => generated 1217 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:21:56.219532 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-635b72c6-86b2-401d-aff3-87da6a2cd72b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:56.220592 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-635b72c6-86b2-401d-aff3-87da6a2cd72b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:56.226621 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-635b72c6-86b2-401d-aff3-87da6a2cd72b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:56.227081 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-635b72c6-86b2-401d-aff3-87da6a2cd72b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:56.227864 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-635b72c6-86b2-401d-aff3-87da6a2cd72b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:56.228305 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-635b72c6-86b2-401d-aff3-87da6a2cd72b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:56.362676 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-635b72c6-86b2-401d-aff3-87da6a2cd72b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:56.370215 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-635b72c6-86b2-401d-aff3-87da6a2cd72b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1680 microversion: 2.1 time: 0.154442 Jan 24 09:21:56.370791 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 389/788] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:21:56 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:21:57.041688 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-5e0a1ee1-231a-412b-bb67-23fb81ec1d3d tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:57.045212 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-5e0a1ee1-231a-412b-bb67-23fb81ec1d3d tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] [instance: bdbfa507-91f3-471e-8723-518082c93741] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:57.093697 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-5e0a1ee1-231a-412b-bb67-23fb81ec1d3d tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a041ed923e234b479a07afe629707504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3fa7c12b554a3bbfd918b6de58df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:57.101174 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-5e0a1ee1-231a-412b-bb67-23fb81ec1d3d tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] 10.222.0.113 "GET /compute/v2.1/servers/bdbfa507-91f3-471e-8723-518082c93741" status: 200 len: 1217 microversion: 2.1 time: 0.063262 Jan 24 09:21:57.101750 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 400/789] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:21:57 2022] GET /compute/v2.1/servers/bdbfa507-91f3-471e-8723-518082c93741 => generated 1217 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:21:57.388115 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-5421ab7d-0e43-4c11-8a3a-5638310757f1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:57.388801 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-5421ab7d-0e43-4c11-8a3a-5638310757f1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:57.396426 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5421ab7d-0e43-4c11-8a3a-5638310757f1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:57.396892 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5421ab7d-0e43-4c11-8a3a-5638310757f1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:57.397684 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5421ab7d-0e43-4c11-8a3a-5638310757f1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:57.398148 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5421ab7d-0e43-4c11-8a3a-5638310757f1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:57.534117 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-5421ab7d-0e43-4c11-8a3a-5638310757f1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:57.541418 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-5421ab7d-0e43-4c11-8a3a-5638310757f1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1657 microversion: 2.1 time: 0.157294 Jan 24 09:21:57.542058 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 390/790] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:21:57 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1657 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:21:57.568234 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-cdc1dac0-43aa-450e-9ea1-c2cf2bbb69db tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:21:57.574170 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-cdc1dac0-43aa-450e-9ea1-c2cf2bbb69db tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:57.574624 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-cdc1dac0-43aa-450e-9ea1-c2cf2bbb69db tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:57.599442 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-cdc1dac0-43aa-450e-9ea1-c2cf2bbb69db tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Going to try to start instance {{(pid=116863) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 24 09:21:58.062251 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-cdc1dac0-43aa-450e-9ea1-c2cf2bbb69db tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action" status: 202 len: 0 microversion: 2.1 time: 0.497520 Jan 24 09:21:58.062904 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 401/791] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:21:57 2022] POST /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/action => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:21:58.071732 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-168db9bc-d9f9-4b4e-ab25-0b56f1cab7c3 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:58.072434 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-168db9bc-d9f9-4b4e-ab25-0b56f1cab7c3 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:58.080076 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-168db9bc-d9f9-4b4e-ab25-0b56f1cab7c3 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:58.080184 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-168db9bc-d9f9-4b4e-ab25-0b56f1cab7c3 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:58.080951 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-168db9bc-d9f9-4b4e-ab25-0b56f1cab7c3 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:58.081446 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-168db9bc-d9f9-4b4e-ab25-0b56f1cab7c3 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:58.119852 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-b4793468-5d0e-4873-97cd-63a876711b7f tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:58.120550 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-b4793468-5d0e-4873-97cd-63a876711b7f tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] [instance: bdbfa507-91f3-471e-8723-518082c93741] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:58.126892 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b4793468-5d0e-4873-97cd-63a876711b7f tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:58.127345 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b4793468-5d0e-4873-97cd-63a876711b7f tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:58.128316 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b4793468-5d0e-4873-97cd-63a876711b7f tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:58.128765 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b4793468-5d0e-4873-97cd-63a876711b7f tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:58.194422 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-b4793468-5d0e-4873-97cd-63a876711b7f tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a041ed923e234b479a07afe629707504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3fa7c12b554a3bbfd918b6de58df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:58.202734 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-b4793468-5d0e-4873-97cd-63a876711b7f tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] 10.222.0.113 "GET /compute/v2.1/servers/bdbfa507-91f3-471e-8723-518082c93741" status: 200 len: 1221 microversion: 2.1 time: 0.086735 Jan 24 09:21:58.210744 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 402/792] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:21:58 2022] GET /compute/v2.1/servers/bdbfa507-91f3-471e-8723-518082c93741 => generated 1221 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:21:58.232443 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-168db9bc-d9f9-4b4e-ab25-0b56f1cab7c3 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:58.241017 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-168db9bc-d9f9-4b4e-ab25-0b56f1cab7c3 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1666 microversion: 2.1 time: 0.173275 Jan 24 09:21:58.242006 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 391/793] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:21:58 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1666 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:21:59.220492 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-5cef6088-2251-4069-8620-34bcb63c3ea7 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:59.221279 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-5cef6088-2251-4069-8620-34bcb63c3ea7 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] [instance: bdbfa507-91f3-471e-8723-518082c93741] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:59.228139 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5cef6088-2251-4069-8620-34bcb63c3ea7 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:59.228588 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5cef6088-2251-4069-8620-34bcb63c3ea7 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:59.229422 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5cef6088-2251-4069-8620-34bcb63c3ea7 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:59.229845 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5cef6088-2251-4069-8620-34bcb63c3ea7 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:59.257991 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-19a08286-0853-40bf-8e59-9ee085710936 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:21:59.258641 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-19a08286-0853-40bf-8e59-9ee085710936 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:21:59.264874 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-19a08286-0853-40bf-8e59-9ee085710936 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:59.265511 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-19a08286-0853-40bf-8e59-9ee085710936 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:59.266339 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-19a08286-0853-40bf-8e59-9ee085710936 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:21:59.266849 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-19a08286-0853-40bf-8e59-9ee085710936 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:21:59.297159 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-5cef6088-2251-4069-8620-34bcb63c3ea7 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a041ed923e234b479a07afe629707504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3fa7c12b554a3bbfd918b6de58df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:59.305516 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-5cef6088-2251-4069-8620-34bcb63c3ea7 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] 10.222.0.113 "GET /compute/v2.1/servers/bdbfa507-91f3-471e-8723-518082c93741" status: 200 len: 1269 microversion: 2.1 time: 0.089304 Jan 24 09:21:59.306122 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 403/794] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:21:59 2022] GET /compute/v2.1/servers/bdbfa507-91f3-471e-8723-518082c93741 => generated 1269 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:21:59.406315 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-19a08286-0853-40bf-8e59-9ee085710936 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:21:59.415042 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-19a08286-0853-40bf-8e59-9ee085710936 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1666 microversion: 2.1 time: 0.160662 Jan 24 09:21:59.415623 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 392/795] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:21:59 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1666 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:22:00.326221 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-726076ae-b6b9-455e-a90d-4704b7266abe tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:00.327384 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-726076ae-b6b9-455e-a90d-4704b7266abe tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] [instance: bdbfa507-91f3-471e-8723-518082c93741] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:00.334432 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-726076ae-b6b9-455e-a90d-4704b7266abe tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:00.334931 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-726076ae-b6b9-455e-a90d-4704b7266abe tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:00.335913 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-726076ae-b6b9-455e-a90d-4704b7266abe tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:00.336974 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-726076ae-b6b9-455e-a90d-4704b7266abe tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:00.410663 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-726076ae-b6b9-455e-a90d-4704b7266abe tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a041ed923e234b479a07afe629707504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3fa7c12b554a3bbfd918b6de58df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:00.417822 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-726076ae-b6b9-455e-a90d-4704b7266abe tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] 10.222.0.113 "GET /compute/v2.1/servers/bdbfa507-91f3-471e-8723-518082c93741" status: 200 len: 1275 microversion: 2.1 time: 0.095250 Jan 24 09:22:00.418424 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 404/796] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:22:00 2022] GET /compute/v2.1/servers/bdbfa507-91f3-471e-8723-518082c93741 => generated 1275 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:22:00.433852 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-a6eaabb4-2bf2-44e9-a969-a0c0b71cc03e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:00.434513 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-a6eaabb4-2bf2-44e9-a969-a0c0b71cc03e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:00.441666 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a6eaabb4-2bf2-44e9-a969-a0c0b71cc03e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:00.442140 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a6eaabb4-2bf2-44e9-a969-a0c0b71cc03e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:00.442934 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a6eaabb4-2bf2-44e9-a969-a0c0b71cc03e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:00.443540 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a6eaabb4-2bf2-44e9-a969-a0c0b71cc03e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:00.587143 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-a6eaabb4-2bf2-44e9-a969-a0c0b71cc03e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:00.595415 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-a6eaabb4-2bf2-44e9-a969-a0c0b71cc03e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1670 microversion: 2.1 time: 0.165149 Jan 24 09:22:00.596137 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 393/797] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:22:00 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1670 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:22:01.436548 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-9e28a8f6-e58a-43c6-9f09-6d224d38ad50 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:01.437084 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-9e28a8f6-e58a-43c6-9f09-6d224d38ad50 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] [instance: bdbfa507-91f3-471e-8723-518082c93741] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:01.445622 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9e28a8f6-e58a-43c6-9f09-6d224d38ad50 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:01.446161 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9e28a8f6-e58a-43c6-9f09-6d224d38ad50 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:01.446914 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9e28a8f6-e58a-43c6-9f09-6d224d38ad50 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:01.447351 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9e28a8f6-e58a-43c6-9f09-6d224d38ad50 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:01.683463 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-9e28a8f6-e58a-43c6-9f09-6d224d38ad50 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a041ed923e234b479a07afe629707504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3fa7c12b554a3bbfd918b6de58df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:01.691937 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-9e28a8f6-e58a-43c6-9f09-6d224d38ad50 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] 10.222.0.113 "GET /compute/v2.1/servers/bdbfa507-91f3-471e-8723-518082c93741" status: 200 len: 1317 microversion: 2.1 time: 0.259144 Jan 24 09:22:01.692895 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 405/798] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:22:01 2022] GET /compute/v2.1/servers/bdbfa507-91f3-471e-8723-518082c93741 => generated 1317 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:22:01.861601 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [req-c415e4c9-7783-40c6-869a-93ef38880509 req-6df4a0de-9eaa-4b1a-9187-517720528d02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdbfa507-91f3-471e-8723-518082c93741", "tag": "b6bd9b58-6950-4543-bdc7-f81d21ad8a81"}]} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:22:01.863853 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:22:01.863853 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: warnings.warn(msg) Jan 24 09:22:01.872172 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-c415e4c9-7783-40c6-869a-93ef38880509 req-6df4a0de-9eaa-4b1a-9187-517720528d02 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:01.872912 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-c415e4c9-7783-40c6-869a-93ef38880509 req-6df4a0de-9eaa-4b1a-9187-517720528d02 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:01.889744 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.compute.server_external_events [req-c415e4c9-7783-40c6-869a-93ef38880509 req-6df4a0de-9eaa-4b1a-9187-517720528d02 service nova] Creating event network-changed:b6bd9b58-6950-4543-bdc7-f81d21ad8a81 for instance bdbfa507-91f3-471e-8723-518082c93741 on hv-cinder-80403 Jan 24 09:22:01.896139 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [req-c415e4c9-7783-40c6-869a-93ef38880509 req-6df4a0de-9eaa-4b1a-9187-517720528d02 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038893 Jan 24 09:22:01.896876 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 394/799] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:22:02.709188 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-9397d204-c781-4c6f-8c71-c279381c0781 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:02.709912 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-9397d204-c781-4c6f-8c71-c279381c0781 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] [instance: bdbfa507-91f3-471e-8723-518082c93741] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:02.716355 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9397d204-c781-4c6f-8c71-c279381c0781 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:02.716797 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9397d204-c781-4c6f-8c71-c279381c0781 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:02.717570 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9397d204-c781-4c6f-8c71-c279381c0781 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:02.718000 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9397d204-c781-4c6f-8c71-c279381c0781 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:02.861491 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-9397d204-c781-4c6f-8c71-c279381c0781 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a041ed923e234b479a07afe629707504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3fa7c12b554a3bbfd918b6de58df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:02.869579 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-9397d204-c781-4c6f-8c71-c279381c0781 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] 10.222.0.113 "GET /compute/v2.1/servers/bdbfa507-91f3-471e-8723-518082c93741" status: 200 len: 1317 microversion: 2.1 time: 0.164537 Jan 24 09:22:02.870175 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 406/800] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:22:02 2022] GET /compute/v2.1/servers/bdbfa507-91f3-471e-8723-518082c93741 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:22:03.887152 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-30977cc1-2d45-4503-a579-4170cc0a4f84 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:03.887853 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-30977cc1-2d45-4503-a579-4170cc0a4f84 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] [instance: bdbfa507-91f3-471e-8723-518082c93741] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:03.895057 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-30977cc1-2d45-4503-a579-4170cc0a4f84 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:03.895508 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-30977cc1-2d45-4503-a579-4170cc0a4f84 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:03.896325 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-30977cc1-2d45-4503-a579-4170cc0a4f84 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:03.896767 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-30977cc1-2d45-4503-a579-4170cc0a4f84 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:04.032900 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-30977cc1-2d45-4503-a579-4170cc0a4f84 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a041ed923e234b479a07afe629707504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3fa7c12b554a3bbfd918b6de58df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:04.040070 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-30977cc1-2d45-4503-a579-4170cc0a4f84 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] 10.222.0.113 "GET /compute/v2.1/servers/bdbfa507-91f3-471e-8723-518082c93741" status: 200 len: 1317 microversion: 2.1 time: 0.157479 Jan 24 09:22:04.040638 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 395/801] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:22:03 2022] GET /compute/v2.1/servers/bdbfa507-91f3-471e-8723-518082c93741 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:22:05.056505 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-361f8796-9ef7-4b64-8f3a-1c74d2f9fe36 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:05.057119 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-361f8796-9ef7-4b64-8f3a-1c74d2f9fe36 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] [instance: bdbfa507-91f3-471e-8723-518082c93741] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:05.063498 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-361f8796-9ef7-4b64-8f3a-1c74d2f9fe36 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:05.063952 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-361f8796-9ef7-4b64-8f3a-1c74d2f9fe36 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:05.064930 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-361f8796-9ef7-4b64-8f3a-1c74d2f9fe36 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:05.065790 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-361f8796-9ef7-4b64-8f3a-1c74d2f9fe36 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:05.199227 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-361f8796-9ef7-4b64-8f3a-1c74d2f9fe36 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a041ed923e234b479a07afe629707504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3fa7c12b554a3bbfd918b6de58df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:05.206728 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-361f8796-9ef7-4b64-8f3a-1c74d2f9fe36 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] 10.222.0.113 "GET /compute/v2.1/servers/bdbfa507-91f3-471e-8723-518082c93741" status: 200 len: 1317 microversion: 2.1 time: 0.153880 Jan 24 09:22:05.207294 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 407/802] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:22:05 2022] GET /compute/v2.1/servers/bdbfa507-91f3-471e-8723-518082c93741 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:22:06.224047 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-a97cda75-acff-45f7-b43c-b83395234df4 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:06.224621 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-a97cda75-acff-45f7-b43c-b83395234df4 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] [instance: bdbfa507-91f3-471e-8723-518082c93741] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:06.230560 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a97cda75-acff-45f7-b43c-b83395234df4 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:06.231017 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a97cda75-acff-45f7-b43c-b83395234df4 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:06.231803 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a97cda75-acff-45f7-b43c-b83395234df4 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:06.232420 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a97cda75-acff-45f7-b43c-b83395234df4 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:06.368636 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-a97cda75-acff-45f7-b43c-b83395234df4 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a041ed923e234b479a07afe629707504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3fa7c12b554a3bbfd918b6de58df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:06.376067 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-a97cda75-acff-45f7-b43c-b83395234df4 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] 10.222.0.113 "GET /compute/v2.1/servers/bdbfa507-91f3-471e-8723-518082c93741" status: 200 len: 1317 microversion: 2.1 time: 0.156525 Jan 24 09:22:06.376871 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 396/803] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:22:06 2022] GET /compute/v2.1/servers/bdbfa507-91f3-471e-8723-518082c93741 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:22:07.393419 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-25ff6cdd-64d9-4827-8a3c-8667438c8ec6 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:07.394032 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-25ff6cdd-64d9-4827-8a3c-8667438c8ec6 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] [instance: bdbfa507-91f3-471e-8723-518082c93741] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:07.400608 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-25ff6cdd-64d9-4827-8a3c-8667438c8ec6 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:07.401062 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-25ff6cdd-64d9-4827-8a3c-8667438c8ec6 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:07.401847 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-25ff6cdd-64d9-4827-8a3c-8667438c8ec6 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:07.402335 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-25ff6cdd-64d9-4827-8a3c-8667438c8ec6 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:07.592029 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-25ff6cdd-64d9-4827-8a3c-8667438c8ec6 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a041ed923e234b479a07afe629707504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3fa7c12b554a3bbfd918b6de58df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:07.603785 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-25ff6cdd-64d9-4827-8a3c-8667438c8ec6 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] 10.222.0.113 "GET /compute/v2.1/servers/bdbfa507-91f3-471e-8723-518082c93741" status: 200 len: 1317 microversion: 2.1 time: 0.212510 Jan 24 09:22:07.603785 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 408/804] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:22:07 2022] GET /compute/v2.1/servers/bdbfa507-91f3-471e-8723-518082c93741 => generated 1317 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:22:07.979086 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [req-946d8405-2faf-4028-af1c-fd31b7622ebe req-fef2feed-f63e-4dab-aa3c-a5e53d1cbf75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdbfa507-91f3-471e-8723-518082c93741", "name": "network-vif-plugged", "status": "completed", "tag": "b6bd9b58-6950-4543-bdc7-f81d21ad8a81"}]} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:22:07.980677 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:22:07.980677 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: warnings.warn(msg) Jan 24 09:22:07.989307 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-946d8405-2faf-4028-af1c-fd31b7622ebe req-fef2feed-f63e-4dab-aa3c-a5e53d1cbf75 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:07.989919 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-946d8405-2faf-4028-af1c-fd31b7622ebe req-fef2feed-f63e-4dab-aa3c-a5e53d1cbf75 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:08.003808 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.compute.server_external_events [req-946d8405-2faf-4028-af1c-fd31b7622ebe req-fef2feed-f63e-4dab-aa3c-a5e53d1cbf75 service nova] Creating event network-vif-plugged:b6bd9b58-6950-4543-bdc7-f81d21ad8a81 for instance bdbfa507-91f3-471e-8723-518082c93741 on hv-cinder-80403 Jan 24 09:22:08.009411 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [req-946d8405-2faf-4028-af1c-fd31b7622ebe req-fef2feed-f63e-4dab-aa3c-a5e53d1cbf75 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034035 Jan 24 09:22:08.010013 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 397/805] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:22:08.619233 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-9b5a0eb2-ac4a-44ea-b9bc-c90fead6ebc8 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:08.619967 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-9b5a0eb2-ac4a-44ea-b9bc-c90fead6ebc8 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] [instance: bdbfa507-91f3-471e-8723-518082c93741] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:08.626521 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9b5a0eb2-ac4a-44ea-b9bc-c90fead6ebc8 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:08.626896 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9b5a0eb2-ac4a-44ea-b9bc-c90fead6ebc8 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:08.627693 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9b5a0eb2-ac4a-44ea-b9bc-c90fead6ebc8 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:08.628130 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9b5a0eb2-ac4a-44ea-b9bc-c90fead6ebc8 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:08.772527 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-9b5a0eb2-ac4a-44ea-b9bc-c90fead6ebc8 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a041ed923e234b479a07afe629707504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3fa7c12b554a3bbfd918b6de58df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:08.780274 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-9b5a0eb2-ac4a-44ea-b9bc-c90fead6ebc8 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] 10.222.0.113 "GET /compute/v2.1/servers/bdbfa507-91f3-471e-8723-518082c93741" status: 200 len: 1317 microversion: 2.1 time: 0.164717 Jan 24 09:22:08.781156 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 409/806] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:22:08 2022] GET /compute/v2.1/servers/bdbfa507-91f3-471e-8723-518082c93741 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:22:09.797977 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-058a11d5-c38e-44c8-b29f-37e4adfdeaed tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:09.799243 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-058a11d5-c38e-44c8-b29f-37e4adfdeaed tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] [instance: bdbfa507-91f3-471e-8723-518082c93741] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:09.804932 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-058a11d5-c38e-44c8-b29f-37e4adfdeaed tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:09.805373 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-058a11d5-c38e-44c8-b29f-37e4adfdeaed tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:09.806167 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-058a11d5-c38e-44c8-b29f-37e4adfdeaed tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:09.806600 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-058a11d5-c38e-44c8-b29f-37e4adfdeaed tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:10.115360 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-058a11d5-c38e-44c8-b29f-37e4adfdeaed tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a041ed923e234b479a07afe629707504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3fa7c12b554a3bbfd918b6de58df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:10.122871 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-058a11d5-c38e-44c8-b29f-37e4adfdeaed tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] 10.222.0.113 "GET /compute/v2.1/servers/bdbfa507-91f3-471e-8723-518082c93741" status: 200 len: 1317 microversion: 2.1 time: 0.329925 Jan 24 09:22:10.123463 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 398/807] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:22:09 2022] GET /compute/v2.1/servers/bdbfa507-91f3-471e-8723-518082c93741 => generated 1317 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:22:11.139990 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-97aba66e-e411-4e2f-a0b9-f12f1aab832a tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:11.140529 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-97aba66e-e411-4e2f-a0b9-f12f1aab832a tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] [instance: bdbfa507-91f3-471e-8723-518082c93741] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:11.146881 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-97aba66e-e411-4e2f-a0b9-f12f1aab832a tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:11.147321 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-97aba66e-e411-4e2f-a0b9-f12f1aab832a tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:11.148209 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-97aba66e-e411-4e2f-a0b9-f12f1aab832a tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:11.148641 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-97aba66e-e411-4e2f-a0b9-f12f1aab832a tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:11.438661 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-97aba66e-e411-4e2f-a0b9-f12f1aab832a tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a041ed923e234b479a07afe629707504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3fa7c12b554a3bbfd918b6de58df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:11.446831 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-97aba66e-e411-4e2f-a0b9-f12f1aab832a tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] 10.222.0.113 "GET /compute/v2.1/servers/bdbfa507-91f3-471e-8723-518082c93741" status: 200 len: 1501 microversion: 2.1 time: 0.310546 Jan 24 09:22:11.447415 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 410/808] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:22:11 2022] GET /compute/v2.1/servers/bdbfa507-91f3-471e-8723-518082c93741 => generated 1501 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:22:11.800039 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-d904b775-438c-4e54-9b65-5d6d84ddd02d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:11.800542 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-d904b775-438c-4e54-9b65-5d6d84ddd02d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:11.808925 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d904b775-438c-4e54-9b65-5d6d84ddd02d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:11.810529 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d904b775-438c-4e54-9b65-5d6d84ddd02d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:11.810529 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d904b775-438c-4e54-9b65-5d6d84ddd02d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:11.811098 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d904b775-438c-4e54-9b65-5d6d84ddd02d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:11.843123 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-d904b775-438c-4e54-9b65-5d6d84ddd02d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/os-volume_attachments/e52e7031-3a8e-466d-bf66-f2405891add7" status: 200 len: 194 microversion: 2.20 time: 0.047443 Jan 24 09:22:11.843724 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 399/809] 10.222.0.113 () {60 vars in 1458 bytes} [Mon Jan 24 09:22:11 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/os-volume_attachments/e52e7031-3a8e-466d-bf66-f2405891add7 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:22:11.906448 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-a747ec57-aec0-475b-97ad-ef9df3c813b0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:11.907050 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-a747ec57-aec0-475b-97ad-ef9df3c813b0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:11.912906 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a747ec57-aec0-475b-97ad-ef9df3c813b0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:11.919110 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a747ec57-aec0-475b-97ad-ef9df3c813b0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:11.919110 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a747ec57-aec0-475b-97ad-ef9df3c813b0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:11.919110 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a747ec57-aec0-475b-97ad-ef9df3c813b0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:12.051376 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.objects.instance [None req-a747ec57-aec0-475b-97ad-ef9df3c813b0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lazy-loading 'services' on Instance uuid b820c156-179a-4172-a02b-6c88713087f1 {{(pid=116863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 09:22:12.152775 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 24 09:22:12.153404 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: Mon Jan 24 09:22:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/os-volume_attachments/e52e7031-3a8e-466d-bf66-f2405891add7 (ip 10.222.0.113) !!! Jan 24 09:22:12.306376 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-a747ec57-aec0-475b-97ad-ef9df3c813b0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "DELETE /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/os-volume_attachments/e52e7031-3a8e-466d-bf66-f2405891add7" status: 202 len: 0 microversion: 2.20 time: 0.403560 Jan 24 09:22:12.306974 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 411/810] 10.222.0.113 () {60 vars in 1461 bytes} [Mon Jan 24 09:22:11 2022] DELETE /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/os-volume_attachments/e52e7031-3a8e-466d-bf66-f2405891add7 => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 24 09:22:12.315334 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-18bd3e3b-604e-4189-a5e1-e7dd5f1e2b9a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:12.316254 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-18bd3e3b-604e-4189-a5e1-e7dd5f1e2b9a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:12.322348 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-18bd3e3b-604e-4189-a5e1-e7dd5f1e2b9a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:12.322798 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-18bd3e3b-604e-4189-a5e1-e7dd5f1e2b9a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:12.323576 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-18bd3e3b-604e-4189-a5e1-e7dd5f1e2b9a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:12.324013 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-18bd3e3b-604e-4189-a5e1-e7dd5f1e2b9a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:12.354719 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-18bd3e3b-604e-4189-a5e1-e7dd5f1e2b9a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043213 Jan 24 09:22:12.355291 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 400/811] 10.222.0.113 () {60 vars in 1347 bytes} [Mon Jan 24 09:22:12 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:22:12.585494 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-e5e6160d-cc91-4535-a75a-72b15442c48b tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:12.586124 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-e5e6160d-cc91-4535-a75a-72b15442c48b tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] [instance: bdbfa507-91f3-471e-8723-518082c93741] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:12.592340 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e5e6160d-cc91-4535-a75a-72b15442c48b tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:12.592797 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e5e6160d-cc91-4535-a75a-72b15442c48b tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:12.593576 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e5e6160d-cc91-4535-a75a-72b15442c48b tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:12.594011 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e5e6160d-cc91-4535-a75a-72b15442c48b tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:12.627758 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-e5e6160d-cc91-4535-a75a-72b15442c48b tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] [instance: bdbfa507-91f3-471e-8723-518082c93741] Going to try to terminate instance {{(pid=116863) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 09:22:12.916687 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-e5e6160d-cc91-4535-a75a-72b15442c48b tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] 10.222.0.113 "DELETE /compute/v2.1/servers/bdbfa507-91f3-471e-8723-518082c93741" status: 204 len: 0 microversion: 2.1 time: 0.334241 Jan 24 09:22:12.917303 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 412/812] 10.222.0.113 () {58 vars in 1243 bytes} [Mon Jan 24 09:22:12 2022] DELETE /compute/v2.1/servers/bdbfa507-91f3-471e-8723-518082c93741 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 24 09:22:12.925523 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-0d9bb3d2-79d4-49ff-8e83-4e54ec10c329 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:12.926171 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-0d9bb3d2-79d4-49ff-8e83-4e54ec10c329 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] [instance: bdbfa507-91f3-471e-8723-518082c93741] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:12.933711 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0d9bb3d2-79d4-49ff-8e83-4e54ec10c329 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:12.940484 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0d9bb3d2-79d4-49ff-8e83-4e54ec10c329 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:12.940484 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0d9bb3d2-79d4-49ff-8e83-4e54ec10c329 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:12.940484 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0d9bb3d2-79d4-49ff-8e83-4e54ec10c329 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:13.080874 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-0d9bb3d2-79d4-49ff-8e83-4e54ec10c329 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a041ed923e234b479a07afe629707504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3fa7c12b554a3bbfd918b6de58df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:13.089081 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-0d9bb3d2-79d4-49ff-8e83-4e54ec10c329 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] 10.222.0.113 "GET /compute/v2.1/servers/bdbfa507-91f3-471e-8723-518082c93741" status: 200 len: 1507 microversion: 2.1 time: 0.167097 Jan 24 09:22:13.095803 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 401/813] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:22:12 2022] GET /compute/v2.1/servers/bdbfa507-91f3-471e-8723-518082c93741 => generated 1507 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:22:13.368682 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-49ea72e5-4aa6-4e60-bcea-b3a0b28acbf2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:13.369841 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-49ea72e5-4aa6-4e60-bcea-b3a0b28acbf2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:13.376628 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-49ea72e5-4aa6-4e60-bcea-b3a0b28acbf2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:13.377067 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-49ea72e5-4aa6-4e60-bcea-b3a0b28acbf2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:13.377847 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-49ea72e5-4aa6-4e60-bcea-b3a0b28acbf2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:13.378302 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-49ea72e5-4aa6-4e60-bcea-b3a0b28acbf2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:13.409794 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-49ea72e5-4aa6-4e60-bcea-b3a0b28acbf2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047090 Jan 24 09:22:13.410426 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 413/814] 10.222.0.113 () {60 vars in 1347 bytes} [Mon Jan 24 09:22:13 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:22:14.106007 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-bc7eb99c-c6fa-454b-99e1-1d58853e6b42 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:14.106691 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-bc7eb99c-c6fa-454b-99e1-1d58853e6b42 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] [instance: bdbfa507-91f3-471e-8723-518082c93741] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:14.113033 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-bc7eb99c-c6fa-454b-99e1-1d58853e6b42 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:14.113487 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-bc7eb99c-c6fa-454b-99e1-1d58853e6b42 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:14.114310 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-bc7eb99c-c6fa-454b-99e1-1d58853e6b42 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:14.114752 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-bc7eb99c-c6fa-454b-99e1-1d58853e6b42 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:14.253312 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-bc7eb99c-c6fa-454b-99e1-1d58853e6b42 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a041ed923e234b479a07afe629707504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3fa7c12b554a3bbfd918b6de58df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:14.262388 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-bc7eb99c-c6fa-454b-99e1-1d58853e6b42 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] 10.222.0.113 "GET /compute/v2.1/servers/bdbfa507-91f3-471e-8723-518082c93741" status: 200 len: 1507 microversion: 2.1 time: 0.160103 Jan 24 09:22:14.263078 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 402/815] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:22:14 2022] GET /compute/v2.1/servers/bdbfa507-91f3-471e-8723-518082c93741 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:22:14.423153 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-e125533c-941d-4910-9c60-3d15cc2fe247 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:14.424105 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-e125533c-941d-4910-9c60-3d15cc2fe247 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:14.435775 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e125533c-941d-4910-9c60-3d15cc2fe247 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:14.436527 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e125533c-941d-4910-9c60-3d15cc2fe247 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:14.437788 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e125533c-941d-4910-9c60-3d15cc2fe247 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:14.438262 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e125533c-941d-4910-9c60-3d15cc2fe247 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:14.472842 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-e125533c-941d-4910-9c60-3d15cc2fe247 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.053749 Jan 24 09:22:14.473530 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 414/816] 10.222.0.113 () {60 vars in 1347 bytes} [Mon Jan 24 09:22:14 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:22:14.538812 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-0ad8921a-6b7f-4bd0-9440-dccd71037acc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:14.539693 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-0ad8921a-6b7f-4bd0-9440-dccd71037acc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:14.549422 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0ad8921a-6b7f-4bd0-9440-dccd71037acc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:14.550184 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0ad8921a-6b7f-4bd0-9440-dccd71037acc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:14.550992 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0ad8921a-6b7f-4bd0-9440-dccd71037acc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:14.551435 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0ad8921a-6b7f-4bd0-9440-dccd71037acc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:14.577881 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-0ad8921a-6b7f-4bd0-9440-dccd71037acc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Going to try to terminate instance {{(pid=116864) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 09:22:14.888977 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-0ad8921a-6b7f-4bd0-9440-dccd71037acc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "DELETE /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 204 len: 0 microversion: 2.20 time: 0.354701 Jan 24 09:22:14.889768 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 403/817] 10.222.0.113 () {60 vars in 1284 bytes} [Mon Jan 24 09:22:14 2022] DELETE /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 24 09:22:14.897861 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-7ec4f7f7-23ab-4158-94ec-3b815bce7fee tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:14.898517 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-7ec4f7f7-23ab-4158-94ec-3b815bce7fee tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:14.904343 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7ec4f7f7-23ab-4158-94ec-3b815bce7fee tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:14.904783 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7ec4f7f7-23ab-4158-94ec-3b815bce7fee tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:14.905554 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7ec4f7f7-23ab-4158-94ec-3b815bce7fee tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:14.905983 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7ec4f7f7-23ab-4158-94ec-3b815bce7fee tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:15.175717 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-7ec4f7f7-23ab-4158-94ec-3b815bce7fee tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:15.184569 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-7ec4f7f7-23ab-4158-94ec-3b815bce7fee tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:15.186063 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-7ec4f7f7-23ab-4158-94ec-3b815bce7fee tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:15.187246 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-7ec4f7f7-23ab-4158-94ec-3b815bce7fee tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1727 microversion: 2.20 time: 0.293264 Jan 24 09:22:15.187818 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 415/818] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:22:14 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1727 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:22:15.280487 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-59a994f0-4135-4023-932b-04fc2507425b tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:15.281110 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-59a994f0-4135-4023-932b-04fc2507425b tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] [instance: bdbfa507-91f3-471e-8723-518082c93741] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:15.288592 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-59a994f0-4135-4023-932b-04fc2507425b tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:15.289042 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-59a994f0-4135-4023-932b-04fc2507425b tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:15.289868 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-59a994f0-4135-4023-932b-04fc2507425b tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:15.290342 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-59a994f0-4135-4023-932b-04fc2507425b tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:15.356923 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-59a994f0-4135-4023-932b-04fc2507425b tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a041ed923e234b479a07afe629707504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3fa7c12b554a3bbfd918b6de58df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:15.365612 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-59a994f0-4135-4023-932b-04fc2507425b tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] 10.222.0.113 "GET /compute/v2.1/servers/bdbfa507-91f3-471e-8723-518082c93741" status: 200 len: 1465 microversion: 2.1 time: 0.088752 Jan 24 09:22:15.369701 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 404/819] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:22:15 2022] GET /compute/v2.1/servers/bdbfa507-91f3-471e-8723-518082c93741 => generated 1465 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:22:15.431336 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [req-46a57f35-0920-4ebc-9184-b76b1ea6f001 req-fe33693d-1b4d-453a-8bf7-9fc4822d4afd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdbfa507-91f3-471e-8723-518082c93741", "name": "network-vif-deleted", "tag": "b6bd9b58-6950-4543-bdc7-f81d21ad8a81"}]} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:22:15.432953 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:22:15.432953 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: warnings.warn(msg) Jan 24 09:22:15.440957 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-46a57f35-0920-4ebc-9184-b76b1ea6f001 req-fe33693d-1b4d-453a-8bf7-9fc4822d4afd service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:15.441399 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-46a57f35-0920-4ebc-9184-b76b1ea6f001 req-fe33693d-1b4d-453a-8bf7-9fc4822d4afd service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:15.454637 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.compute.server_external_events [req-46a57f35-0920-4ebc-9184-b76b1ea6f001 req-fe33693d-1b4d-453a-8bf7-9fc4822d4afd service nova] Creating event network-vif-deleted:b6bd9b58-6950-4543-bdc7-f81d21ad8a81 for instance bdbfa507-91f3-471e-8723-518082c93741 on hv-cinder-80403 Jan 24 09:22:15.459928 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [req-46a57f35-0920-4ebc-9184-b76b1ea6f001 req-fe33693d-1b4d-453a-8bf7-9fc4822d4afd service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033082 Jan 24 09:22:15.460533 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 416/820] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:22:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:22:16.206632 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-04a0d626-1461-4e88-a764-4037ae574702 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:16.207247 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-04a0d626-1461-4e88-a764-4037ae574702 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:16.214208 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-04a0d626-1461-4e88-a764-4037ae574702 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:16.214660 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-04a0d626-1461-4e88-a764-4037ae574702 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:16.215506 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-04a0d626-1461-4e88-a764-4037ae574702 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:16.215950 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-04a0d626-1461-4e88-a764-4037ae574702 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:16.365612 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-04a0d626-1461-4e88-a764-4037ae574702 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:16.371979 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-04a0d626-1461-4e88-a764-4037ae574702 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:16.373468 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-04a0d626-1461-4e88-a764-4037ae574702 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:16.374653 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-04a0d626-1461-4e88-a764-4037ae574702 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1727 microversion: 2.20 time: 0.171731 Jan 24 09:22:16.375211 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 405/821] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:22:16 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1727 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:22:16.383798 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-22b5cf35-16e9-4648-b52c-2f7557346939 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:16.384574 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-22b5cf35-16e9-4648-b52c-2f7557346939 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] [instance: bdbfa507-91f3-471e-8723-518082c93741] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:16.390792 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-22b5cf35-16e9-4648-b52c-2f7557346939 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:16.395436 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-22b5cf35-16e9-4648-b52c-2f7557346939 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:16.395436 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-22b5cf35-16e9-4648-b52c-2f7557346939 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:16.395436 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-22b5cf35-16e9-4648-b52c-2f7557346939 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:16.426839 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-22b5cf35-16e9-4648-b52c-2f7557346939 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:16.427343 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-22b5cf35-16e9-4648-b52c-2f7557346939 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:16.427791 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.objects.instance [None req-22b5cf35-16e9-4648-b52c-2f7557346939 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lazy-loading 'fault' on Instance uuid bdbfa507-91f3-471e-8723-518082c93741 {{(pid=116863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 09:22:16.467818 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-22b5cf35-16e9-4648-b52c-2f7557346939 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a041ed923e234b479a07afe629707504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3fa7c12b554a3bbfd918b6de58df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:16.476208 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-22b5cf35-16e9-4648-b52c-2f7557346939 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] 10.222.0.113 "GET /compute/v2.1/servers/bdbfa507-91f3-471e-8723-518082c93741" status: 200 len: 1307 microversion: 2.1 time: 0.096882 Jan 24 09:22:16.477092 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 417/822] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:22:16 2022] GET /compute/v2.1/servers/bdbfa507-91f3-471e-8723-518082c93741 => generated 1307 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:22:17.392905 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-b5f19dd0-f936-47bf-9f0a-dc45119b51a5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:17.393595 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-b5f19dd0-f936-47bf-9f0a-dc45119b51a5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:17.401162 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b5f19dd0-f936-47bf-9f0a-dc45119b51a5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:17.401687 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b5f19dd0-f936-47bf-9f0a-dc45119b51a5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:17.402736 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b5f19dd0-f936-47bf-9f0a-dc45119b51a5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:17.403178 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b5f19dd0-f936-47bf-9f0a-dc45119b51a5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:17.494830 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-314ae2a8-3a02-40c0-bfbe-8cf168f9a0a7 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:17.495434 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-314ae2a8-3a02-40c0-bfbe-8cf168f9a0a7 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] [instance: bdbfa507-91f3-471e-8723-518082c93741] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:17.506173 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-314ae2a8-3a02-40c0-bfbe-8cf168f9a0a7 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:17.506920 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-314ae2a8-3a02-40c0-bfbe-8cf168f9a0a7 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:17.507762 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-314ae2a8-3a02-40c0-bfbe-8cf168f9a0a7 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:17.508202 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-314ae2a8-3a02-40c0-bfbe-8cf168f9a0a7 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:17.535075 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.wsgi [None req-314ae2a8-3a02-40c0-bfbe-8cf168f9a0a7 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] HTTP exception thrown: Instance bdbfa507-91f3-471e-8723-518082c93741 could not be found. Jan 24 09:22:17.536012 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-314ae2a8-3a02-40c0-bfbe-8cf168f9a0a7 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Returning 404 to user: Instance bdbfa507-91f3-471e-8723-518082c93741 could not be found. {{(pid=116863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:22:17.537410 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-314ae2a8-3a02-40c0-bfbe-8cf168f9a0a7 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] 10.222.0.113 "GET /compute/v2.1/servers/bdbfa507-91f3-471e-8723-518082c93741" status: 404 len: 111 microversion: 2.1 time: 0.048059 Jan 24 09:22:17.538563 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 418/823] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:22:17 2022] GET /compute/v2.1/servers/bdbfa507-91f3-471e-8723-518082c93741 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 09:22:17.597117 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-b5f19dd0-f936-47bf-9f0a-dc45119b51a5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:17.605461 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-b5f19dd0-f936-47bf-9f0a-dc45119b51a5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:17.607088 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-b5f19dd0-f936-47bf-9f0a-dc45119b51a5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:17.608253 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-b5f19dd0-f936-47bf-9f0a-dc45119b51a5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1727 microversion: 2.20 time: 0.219528 Jan 24 09:22:17.608814 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 406/824] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:22:17 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1727 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:22:17.643440 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-31901807-9593-4def-aab2-88f601ed3146 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1655398680", "imageRef": "c527e37f-a381-465e-babe-11528029ed9b", "flavorRef": "452", "networks": [{"uuid": "44105748-356f-448f-a70c-5d65f0a57e7a"}]}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:22:17.699185 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.network.neutron [None req-31901807-9593-4def-aab2-88f601ed3146 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] validate_networks() for [('44105748-356f-448f-a70c-5d65f0a57e7a', None, None, None, None, None)] {{(pid=116863) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 09:22:18.196502 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [req-1990d822-83f9-4286-a380-1a79f535c5b9 req-7c7d055d-db2b-4df2-9409-dc7212b4c1dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b820c156-179a-4172-a02b-6c88713087f1", "name": "network-vif-deleted", "tag": "73ec9bcf-7f40-4fd5-9968-de1accae6f03"}]} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:22:18.198381 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:22:18.198381 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: warnings.warn(msg) Jan 24 09:22:18.205888 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-1990d822-83f9-4286-a380-1a79f535c5b9 req-7c7d055d-db2b-4df2-9409-dc7212b4c1dc service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:18.206369 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-1990d822-83f9-4286-a380-1a79f535c5b9 req-7c7d055d-db2b-4df2-9409-dc7212b4c1dc service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:18.222357 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.compute.server_external_events [req-1990d822-83f9-4286-a380-1a79f535c5b9 req-7c7d055d-db2b-4df2-9409-dc7212b4c1dc service nova] Creating event network-vif-deleted:73ec9bcf-7f40-4fd5-9968-de1accae6f03 for instance b820c156-179a-4172-a02b-6c88713087f1 on hv-cinder-80403 Jan 24 09:22:18.228947 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [req-1990d822-83f9-4286-a380-1a79f535c5b9 req-7c7d055d-db2b-4df2-9409-dc7212b4c1dc service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036645 Jan 24 09:22:18.230157 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 407/825] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:22:18.388651 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.virt.hardware [None req-31901807-9593-4def-aab2-88f601ed3146 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Flavor limits 0:0:0 {{(pid=116863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 09:22:18.390041 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.virt.hardware [None req-31901807-9593-4def-aab2-88f601ed3146 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Image limits 0:0:0 {{(pid=116863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 09:22:18.390705 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.virt.hardware [None req-31901807-9593-4def-aab2-88f601ed3146 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Flavor pref 0:0:0 {{(pid=116863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 09:22:18.391388 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.virt.hardware [None req-31901807-9593-4def-aab2-88f601ed3146 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Image pref 0:0:0 {{(pid=116863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 09:22:18.391793 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.virt.hardware [None req-31901807-9593-4def-aab2-88f601ed3146 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 09:22:18.404346 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-31901807-9593-4def-aab2-88f601ed3146 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:18.404787 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-31901807-9593-4def-aab2-88f601ed3146 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:18.405581 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-31901807-9593-4def-aab2-88f601ed3146 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:18.406009 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-31901807-9593-4def-aab2-88f601ed3146 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:18.424910 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.quota [None req-31901807-9593-4def-aab2-88f601ed3146 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Getting quotas for project bc3fa7c12b554a3bbfd918b6de58df20. Resources: {'ram', 'cores', 'instances'} {{(pid=116863) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 09:22:18.437493 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.quota [None req-31901807-9593-4def-aab2-88f601ed3146 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Getting quotas for user a041ed923e234b479a07afe629707504 and project bc3fa7c12b554a3bbfd918b6de58df20. Resources: {'ram', 'cores', 'instances'} {{(pid=116863) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 09:22:18.451437 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-31901807-9593-4def-aab2-88f601ed3146 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Going to run 1 instances... {{(pid=116863) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 09:22:18.453974 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-31901807-9593-4def-aab2-88f601ed3146 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] [instance: a041ef9e-83b8-4b8e-8ce7-8138654f603a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c527e37f-a381-465e-babe-11528029ed9b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 09:22:18.630416 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-75014539-2fc4-494d-a569-bca629bc49d6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:18.631717 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-75014539-2fc4-494d-a569-bca629bc49d6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:18.639279 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-75014539-2fc4-494d-a569-bca629bc49d6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:18.639869 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-75014539-2fc4-494d-a569-bca629bc49d6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:18.650987 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-75014539-2fc4-494d-a569-bca629bc49d6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:18.650987 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-75014539-2fc4-494d-a569-bca629bc49d6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:18.654993 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-31901807-9593-4def-aab2-88f601ed3146 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.015202 Jan 24 09:22:18.655659 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 419/826] 10.222.0.113 () {60 vars in 1151 bytes} [Mon Jan 24 09:22:17 2022] POST /compute/v2.1/servers => generated 382 bytes in 1017 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 24 09:22:18.667261 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-69ef277e-5a3d-4706-b4f4-0b09b5635f51 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:18.667994 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-69ef277e-5a3d-4706-b4f4-0b09b5635f51 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] [instance: a041ef9e-83b8-4b8e-8ce7-8138654f603a] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:18.720602 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-75014539-2fc4-494d-a569-bca629bc49d6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:18.721299 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-75014539-2fc4-494d-a569-bca629bc49d6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:18.722520 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.objects.instance [None req-75014539-2fc4-494d-a569-bca629bc49d6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lazy-loading 'fault' on Instance uuid b820c156-179a-4172-a02b-6c88713087f1 {{(pid=116864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 09:22:18.738730 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-69ef277e-5a3d-4706-b4f4-0b09b5635f51 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a041ed923e234b479a07afe629707504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3fa7c12b554a3bbfd918b6de58df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:18.747828 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-69ef277e-5a3d-4706-b4f4-0b09b5635f51 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] 10.222.0.113 "GET /compute/v2.1/servers/a041ef9e-83b8-4b8e-8ce7-8138654f603a" status: 200 len: 1218 microversion: 2.1 time: 0.086003 Jan 24 09:22:18.751406 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 420/827] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:22:18 2022] GET /compute/v2.1/servers/a041ef9e-83b8-4b8e-8ce7-8138654f603a => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:22:18.771596 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-75014539-2fc4-494d-a569-bca629bc49d6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:18.779801 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-75014539-2fc4-494d-a569-bca629bc49d6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:18.781467 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-75014539-2fc4-494d-a569-bca629bc49d6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:18.783013 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-75014539-2fc4-494d-a569-bca629bc49d6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 200 len: 1375 microversion: 2.20 time: 0.159175 Jan 24 09:22:18.783747 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 408/828] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:22:18 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 1375 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:22:19.770868 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-a00f0810-4603-4eed-b1cd-b5913f55c12f tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:19.771941 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-a00f0810-4603-4eed-b1cd-b5913f55c12f tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] [instance: a041ef9e-83b8-4b8e-8ce7-8138654f603a] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:19.801679 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-26836bbd-15c3-426b-9c67-d0c1d220cb8d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:19.803042 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-26836bbd-15c3-426b-9c67-d0c1d220cb8d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:19.811165 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-26836bbd-15c3-426b-9c67-d0c1d220cb8d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:19.812446 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-26836bbd-15c3-426b-9c67-d0c1d220cb8d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:19.814887 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-26836bbd-15c3-426b-9c67-d0c1d220cb8d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:19.815970 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-26836bbd-15c3-426b-9c67-d0c1d220cb8d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:19.839848 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.wsgi [None req-26836bbd-15c3-426b-9c67-d0c1d220cb8d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] HTTP exception thrown: Instance b820c156-179a-4172-a02b-6c88713087f1 could not be found. Jan 24 09:22:19.840648 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-26836bbd-15c3-426b-9c67-d0c1d220cb8d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Returning 404 to user: Instance b820c156-179a-4172-a02b-6c88713087f1 could not be found. {{(pid=116864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:22:19.841664 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-26836bbd-15c3-426b-9c67-d0c1d220cb8d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 404 len: 111 microversion: 2.20 time: 0.044028 Jan 24 09:22:19.842413 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 409/829] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:22:19 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 24 09:22:19.851324 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-d6349f32-c891-4564-b1a0-990fc436b923 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '.version_select at 0x7f473d353820>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:19.868263 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-a00f0810-4603-4eed-b1cd-b5913f55c12f tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a041ed923e234b479a07afe629707504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3fa7c12b554a3bbfd918b6de58df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:19.875343 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-a00f0810-4603-4eed-b1cd-b5913f55c12f tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] 10.222.0.113 "GET /compute/v2.1/servers/a041ef9e-83b8-4b8e-8ce7-8138654f603a" status: 200 len: 1218 microversion: 2.1 time: 0.108752 Jan 24 09:22:19.875967 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 421/830] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:22:19 2022] GET /compute/v2.1/servers/a041ef9e-83b8-4b8e-8ce7-8138654f603a => generated 1218 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:22:19.984352 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-d6349f32-c891-4564-b1a0-990fc436b923 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-437373915" status: 204 len: 0 microversion: 2.20 time: 0.137220 Jan 24 09:22:19.985070 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 410/831] 10.222.0.113 () {60 vars in 1263 bytes} [Mon Jan 24 09:22:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-437373915 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jan 24 09:22:20.892959 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-85f3ce6f-e565-46f7-bd44-80eb28531d49 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:20.893572 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-85f3ce6f-e565-46f7-bd44-80eb28531d49 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] [instance: a041ef9e-83b8-4b8e-8ce7-8138654f603a] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:20.905448 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-85f3ce6f-e565-46f7-bd44-80eb28531d49 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:20.911268 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-85f3ce6f-e565-46f7-bd44-80eb28531d49 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:20.913549 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-85f3ce6f-e565-46f7-bd44-80eb28531d49 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:20.914835 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-85f3ce6f-e565-46f7-bd44-80eb28531d49 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:20.985540 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-85f3ce6f-e565-46f7-bd44-80eb28531d49 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a041ed923e234b479a07afe629707504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3fa7c12b554a3bbfd918b6de58df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:20.995991 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-85f3ce6f-e565-46f7-bd44-80eb28531d49 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] 10.222.0.113 "GET /compute/v2.1/servers/a041ef9e-83b8-4b8e-8ce7-8138654f603a" status: 200 len: 1270 microversion: 2.1 time: 0.106773 Jan 24 09:22:20.996784 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 422/832] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:22:20 2022] GET /compute/v2.1/servers/a041ef9e-83b8-4b8e-8ce7-8138654f603a => generated 1270 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:22:21.039554 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-026bca69-88d9-41be-ad88-384e536ed5f4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'create', calling method: .version_select at 0x7f473d2fa280>, body: {"keypair": {"name": "tempest-keypair-610263263"}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:22:21.055611 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.quota [None req-026bca69-88d9-41be-ad88-384e536ed5f4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Getting quotas for project 94bb7ee37f9545c7a38065c3e1a3b6c1. Resources: {'key_pairs'} {{(pid=116864) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 09:22:21.059674 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.quota [None req-026bca69-88d9-41be-ad88-384e536ed5f4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Getting quotas for user 3527d1517fb0466a8b6375e40870b474 and project 94bb7ee37f9545c7a38065c3e1a3b6c1. Resources: {'key_pairs'} {{(pid=116864) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 09:22:21.499708 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.quota [None req-026bca69-88d9-41be-ad88-384e536ed5f4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Getting quotas for project 94bb7ee37f9545c7a38065c3e1a3b6c1. Resources: {'key_pairs'} {{(pid=116864) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 09:22:21.503901 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.quota [None req-026bca69-88d9-41be-ad88-384e536ed5f4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Getting quotas for user 3527d1517fb0466a8b6375e40870b474 and project 94bb7ee37f9545c7a38065c3e1a3b6c1. Resources: {'key_pairs'} {{(pid=116864) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 09:22:21.518847 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-026bca69-88d9-41be-ad88-384e536ed5f4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.483836 Jan 24 09:22:21.519511 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 411/833] 10.222.0.113 () {62 vars in 1203 bytes} [Mon Jan 24 09:22:21 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 485 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 24 09:22:22.016745 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-4ec60f8f-f33c-4f50-9921-f13b02041ef3 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:22.017607 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-4ec60f8f-f33c-4f50-9921-f13b02041ef3 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] [instance: a041ef9e-83b8-4b8e-8ce7-8138654f603a] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:22.031475 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4ec60f8f-f33c-4f50-9921-f13b02041ef3 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:22.031999 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4ec60f8f-f33c-4f50-9921-f13b02041ef3 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:22.032933 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4ec60f8f-f33c-4f50-9921-f13b02041ef3 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:22.033433 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4ec60f8f-f33c-4f50-9921-f13b02041ef3 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:22.125634 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-4ec60f8f-f33c-4f50-9921-f13b02041ef3 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a041ed923e234b479a07afe629707504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3fa7c12b554a3bbfd918b6de58df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:22.134000 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-4ec60f8f-f33c-4f50-9921-f13b02041ef3 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] 10.222.0.113 "GET /compute/v2.1/servers/a041ef9e-83b8-4b8e-8ce7-8138654f603a" status: 200 len: 1276 microversion: 2.1 time: 0.124305 Jan 24 09:22:22.134616 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 423/834] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:22:22 2022] GET /compute/v2.1/servers/a041ef9e-83b8-4b8e-8ce7-8138654f603a => generated 1276 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:22:23.153299 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-bfd0f38f-5dd7-4a11-aaf3-f8dc2e947fc9 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:23.153955 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-bfd0f38f-5dd7-4a11-aaf3-f8dc2e947fc9 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] [instance: a041ef9e-83b8-4b8e-8ce7-8138654f603a] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:23.160223 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-bfd0f38f-5dd7-4a11-aaf3-f8dc2e947fc9 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:23.160754 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-bfd0f38f-5dd7-4a11-aaf3-f8dc2e947fc9 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:23.161702 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-bfd0f38f-5dd7-4a11-aaf3-f8dc2e947fc9 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:23.162164 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-bfd0f38f-5dd7-4a11-aaf3-f8dc2e947fc9 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:23.305263 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [req-dffe5d39-0eda-4929-985f-19e9e165e349 req-5712ba28-d600-4439-9b12-27b9fee35dfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a041ef9e-83b8-4b8e-8ce7-8138654f603a", "tag": "622af5fd-161f-45e6-9306-74b0695ac44b"}]} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:22:23.310463 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:22:23.310463 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: warnings.warn(msg) Jan 24 09:22:23.313501 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-bfd0f38f-5dd7-4a11-aaf3-f8dc2e947fc9 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a041ed923e234b479a07afe629707504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3fa7c12b554a3bbfd918b6de58df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:23.320198 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-dffe5d39-0eda-4929-985f-19e9e165e349 req-5712ba28-d600-4439-9b12-27b9fee35dfa service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:23.321680 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-dffe5d39-0eda-4929-985f-19e9e165e349 req-5712ba28-d600-4439-9b12-27b9fee35dfa service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:23.325189 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-bfd0f38f-5dd7-4a11-aaf3-f8dc2e947fc9 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] 10.222.0.113 "GET /compute/v2.1/servers/a041ef9e-83b8-4b8e-8ce7-8138654f603a" status: 200 len: 1318 microversion: 2.1 time: 0.176170 Jan 24 09:22:23.335926 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 412/835] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:22:23 2022] GET /compute/v2.1/servers/a041ef9e-83b8-4b8e-8ce7-8138654f603a => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:22:23.336048 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.compute.server_external_events [req-dffe5d39-0eda-4929-985f-19e9e165e349 req-5712ba28-d600-4439-9b12-27b9fee35dfa service nova] Creating event network-changed:622af5fd-161f-45e6-9306-74b0695ac44b for instance a041ef9e-83b8-4b8e-8ce7-8138654f603a on hv-cinder-80403 Jan 24 09:22:23.346746 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [req-dffe5d39-0eda-4929-985f-19e9e165e349 req-5712ba28-d600-4439-9b12-27b9fee35dfa service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042498 Jan 24 09:22:23.346746 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 424/836] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:22:24.355399 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-1f600b6d-c487-4c14-a54f-fcfd345f2b91 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:24.356039 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-1f600b6d-c487-4c14-a54f-fcfd345f2b91 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] [instance: a041ef9e-83b8-4b8e-8ce7-8138654f603a] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:24.362879 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1f600b6d-c487-4c14-a54f-fcfd345f2b91 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:24.363588 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1f600b6d-c487-4c14-a54f-fcfd345f2b91 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:24.365069 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1f600b6d-c487-4c14-a54f-fcfd345f2b91 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:24.365576 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1f600b6d-c487-4c14-a54f-fcfd345f2b91 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:24.511008 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-1f600b6d-c487-4c14-a54f-fcfd345f2b91 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a041ed923e234b479a07afe629707504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3fa7c12b554a3bbfd918b6de58df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:24.518371 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-1f600b6d-c487-4c14-a54f-fcfd345f2b91 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] 10.222.0.113 "GET /compute/v2.1/servers/a041ef9e-83b8-4b8e-8ce7-8138654f603a" status: 200 len: 1318 microversion: 2.1 time: 0.179688 Jan 24 09:22:24.518970 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 413/837] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:22:24 2022] GET /compute/v2.1/servers/a041ef9e-83b8-4b8e-8ce7-8138654f603a => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:22:24.842692 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-e4758c60-2bc9-42c2-b722-07178621637e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-666255872", "imageRef": "c527e37f-a381-465e-babe-11528029ed9b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b0d83e5f-030e-4cd8-ac08-bbed93fad267"}], "security_groups": [{"name": "tempest-securitygroup--421554385"}], "key_name": "tempest-keypair-610263263", "user_data": "}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:22:24.986164 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.network.neutron [None req-e4758c60-2bc9-42c2-b722-07178621637e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] validate_networks() for [('b0d83e5f-030e-4cd8-ac08-bbed93fad267', None, None, None, None, None)] {{(pid=116863) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 09:22:25.381823 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.virt.hardware [None req-e4758c60-2bc9-42c2-b722-07178621637e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Flavor limits 0:0:0 {{(pid=116863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 09:22:25.382284 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.virt.hardware [None req-e4758c60-2bc9-42c2-b722-07178621637e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Image limits 0:0:0 {{(pid=116863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 09:22:25.382760 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.virt.hardware [None req-e4758c60-2bc9-42c2-b722-07178621637e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Flavor pref 0:0:0 {{(pid=116863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 09:22:25.383169 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.virt.hardware [None req-e4758c60-2bc9-42c2-b722-07178621637e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Image pref 0:0:0 {{(pid=116863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 09:22:25.383580 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.virt.hardware [None req-e4758c60-2bc9-42c2-b722-07178621637e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 09:22:25.392254 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e4758c60-2bc9-42c2-b722-07178621637e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:25.392704 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e4758c60-2bc9-42c2-b722-07178621637e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:25.393514 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e4758c60-2bc9-42c2-b722-07178621637e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:25.393953 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e4758c60-2bc9-42c2-b722-07178621637e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:25.412494 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.quota [None req-e4758c60-2bc9-42c2-b722-07178621637e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Getting quotas for project 94bb7ee37f9545c7a38065c3e1a3b6c1. Resources: {'ram', 'cores', 'instances'} {{(pid=116863) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 09:22:25.416401 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.quota [None req-e4758c60-2bc9-42c2-b722-07178621637e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Getting quotas for user 3527d1517fb0466a8b6375e40870b474 and project 94bb7ee37f9545c7a38065c3e1a3b6c1. Resources: {'ram', 'cores', 'instances'} {{(pid=116863) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 09:22:25.427377 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-e4758c60-2bc9-42c2-b722-07178621637e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Going to run 1 instances... {{(pid=116863) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 09:22:25.429972 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-e4758c60-2bc9-42c2-b722-07178621637e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c527e37f-a381-465e-babe-11528029ed9b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 09:22:25.534649 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-330f152a-72a4-4c83-a000-7dd919294f59 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:25.535440 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-330f152a-72a4-4c83-a000-7dd919294f59 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] [instance: a041ef9e-83b8-4b8e-8ce7-8138654f603a] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:25.542348 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-330f152a-72a4-4c83-a000-7dd919294f59 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:25.543017 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-330f152a-72a4-4c83-a000-7dd919294f59 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:25.543787 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-330f152a-72a4-4c83-a000-7dd919294f59 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:25.544383 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-330f152a-72a4-4c83-a000-7dd919294f59 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:25.618118 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-e4758c60-2bc9-42c2-b722-07178621637e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.20 time: 0.780488 Jan 24 09:22:25.618776 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 425/838] 10.222.0.113 () {62 vars in 1192 bytes} [Mon Jan 24 09:22:24 2022] POST /compute/v2.1/servers => generated 403 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jan 24 09:22:25.630484 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-ee94074c-34df-4d1c-81d3-7cca2fefe069 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:25.647371 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-ee94074c-34df-4d1c-81d3-7cca2fefe069 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:25.687499 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-330f152a-72a4-4c83-a000-7dd919294f59 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a041ed923e234b479a07afe629707504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3fa7c12b554a3bbfd918b6de58df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:25.695734 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-330f152a-72a4-4c83-a000-7dd919294f59 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] 10.222.0.113 "GET /compute/v2.1/servers/a041ef9e-83b8-4b8e-8ce7-8138654f603a" status: 200 len: 1318 microversion: 2.1 time: 0.164736 Jan 24 09:22:25.696415 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 414/839] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:22:25 2022] GET /compute/v2.1/servers/a041ef9e-83b8-4b8e-8ce7-8138654f603a => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:22:25.700396 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-ee94074c-34df-4d1c-81d3-7cca2fefe069 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:25.708702 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-ee94074c-34df-4d1c-81d3-7cca2fefe069 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:25.712515 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-ee94074c-34df-4d1c-81d3-7cca2fefe069 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:25.712515 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-ee94074c-34df-4d1c-81d3-7cca2fefe069 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1284 microversion: 2.20 time: 0.086158 Jan 24 09:22:25.712515 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 426/840] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:22:25 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:22:26.713023 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-5c8ed0ee-9c85-4e85-ac64-85d33b5d3e73 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:26.713701 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-5c8ed0ee-9c85-4e85-ac64-85d33b5d3e73 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] [instance: a041ef9e-83b8-4b8e-8ce7-8138654f603a] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:26.721488 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5c8ed0ee-9c85-4e85-ac64-85d33b5d3e73 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:26.721988 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5c8ed0ee-9c85-4e85-ac64-85d33b5d3e73 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:26.723321 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5c8ed0ee-9c85-4e85-ac64-85d33b5d3e73 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:26.724349 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5c8ed0ee-9c85-4e85-ac64-85d33b5d3e73 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:26.731940 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-6eb11531-186f-4e6d-882d-6401844c0efc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:26.732483 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-6eb11531-186f-4e6d-882d-6401844c0efc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:26.739138 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6eb11531-186f-4e6d-882d-6401844c0efc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:26.739825 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6eb11531-186f-4e6d-882d-6401844c0efc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:26.740612 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6eb11531-186f-4e6d-882d-6401844c0efc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:26.741051 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6eb11531-186f-4e6d-882d-6401844c0efc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:26.811141 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-6eb11531-186f-4e6d-882d-6401844c0efc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:26.819374 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-6eb11531-186f-4e6d-882d-6401844c0efc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:26.820903 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-6eb11531-186f-4e6d-882d-6401844c0efc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:26.822006 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-6eb11531-186f-4e6d-882d-6401844c0efc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1288 microversion: 2.20 time: 0.095842 Jan 24 09:22:26.822598 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 427/841] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:22:26 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1288 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:22:26.871916 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-5c8ed0ee-9c85-4e85-ac64-85d33b5d3e73 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a041ed923e234b479a07afe629707504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3fa7c12b554a3bbfd918b6de58df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:26.879201 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-5c8ed0ee-9c85-4e85-ac64-85d33b5d3e73 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] 10.222.0.113 "GET /compute/v2.1/servers/a041ef9e-83b8-4b8e-8ce7-8138654f603a" status: 200 len: 1318 microversion: 2.1 time: 0.169935 Jan 24 09:22:26.879766 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 415/842] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:22:26 2022] GET /compute/v2.1/servers/a041ef9e-83b8-4b8e-8ce7-8138654f603a => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:22:27.839981 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-663de63a-c5e3-4ee2-97c4-d36cc11cda15 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:27.840601 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-663de63a-c5e3-4ee2-97c4-d36cc11cda15 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:27.847450 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-663de63a-c5e3-4ee2-97c4-d36cc11cda15 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:27.847961 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-663de63a-c5e3-4ee2-97c4-d36cc11cda15 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:27.848896 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-663de63a-c5e3-4ee2-97c4-d36cc11cda15 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:27.849701 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-663de63a-c5e3-4ee2-97c4-d36cc11cda15 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:27.898299 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-d16ecd70-fb23-4238-af9c-d6231f0784a8 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:27.898932 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-d16ecd70-fb23-4238-af9c-d6231f0784a8 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] [instance: a041ef9e-83b8-4b8e-8ce7-8138654f603a] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:27.905788 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d16ecd70-fb23-4238-af9c-d6231f0784a8 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:27.906284 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d16ecd70-fb23-4238-af9c-d6231f0784a8 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:27.907233 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d16ecd70-fb23-4238-af9c-d6231f0784a8 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:27.907676 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d16ecd70-fb23-4238-af9c-d6231f0784a8 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:27.915798 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-663de63a-c5e3-4ee2-97c4-d36cc11cda15 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:27.924276 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-663de63a-c5e3-4ee2-97c4-d36cc11cda15 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:27.925788 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-663de63a-c5e3-4ee2-97c4-d36cc11cda15 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:27.927537 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-663de63a-c5e3-4ee2-97c4-d36cc11cda15 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1336 microversion: 2.20 time: 0.090919 Jan 24 09:22:27.928348 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 428/843] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:22:27 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1336 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:22:28.053623 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-d16ecd70-fb23-4238-af9c-d6231f0784a8 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a041ed923e234b479a07afe629707504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3fa7c12b554a3bbfd918b6de58df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:28.062072 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-d16ecd70-fb23-4238-af9c-d6231f0784a8 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] 10.222.0.113 "GET /compute/v2.1/servers/a041ef9e-83b8-4b8e-8ce7-8138654f603a" status: 200 len: 1318 microversion: 2.1 time: 0.168539 Jan 24 09:22:28.062675 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 416/844] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:22:27 2022] GET /compute/v2.1/servers/a041ef9e-83b8-4b8e-8ce7-8138654f603a => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:22:28.945659 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-c33a7f04-6269-4f58-9050-e136ee5a206e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:28.946418 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-c33a7f04-6269-4f58-9050-e136ee5a206e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:28.952810 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c33a7f04-6269-4f58-9050-e136ee5a206e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:28.953253 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c33a7f04-6269-4f58-9050-e136ee5a206e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:28.954034 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c33a7f04-6269-4f58-9050-e136ee5a206e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:28.954495 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c33a7f04-6269-4f58-9050-e136ee5a206e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:29.028746 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-c33a7f04-6269-4f58-9050-e136ee5a206e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:29.038111 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-c33a7f04-6269-4f58-9050-e136ee5a206e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:29.039792 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-c33a7f04-6269-4f58-9050-e136ee5a206e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:29.040918 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-c33a7f04-6269-4f58-9050-e136ee5a206e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1342 microversion: 2.20 time: 0.098958 Jan 24 09:22:29.044922 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 429/845] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:22:28 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1342 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:22:29.079964 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-bcd16eda-6265-4e7f-8289-a920e757fb54 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:29.081328 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-bcd16eda-6265-4e7f-8289-a920e757fb54 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] [instance: a041ef9e-83b8-4b8e-8ce7-8138654f603a] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:29.089054 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-bcd16eda-6265-4e7f-8289-a920e757fb54 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:29.089484 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-bcd16eda-6265-4e7f-8289-a920e757fb54 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:29.090592 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-bcd16eda-6265-4e7f-8289-a920e757fb54 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:29.090803 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-bcd16eda-6265-4e7f-8289-a920e757fb54 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:29.241813 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-bcd16eda-6265-4e7f-8289-a920e757fb54 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a041ed923e234b479a07afe629707504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3fa7c12b554a3bbfd918b6de58df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:29.249706 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-bcd16eda-6265-4e7f-8289-a920e757fb54 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] 10.222.0.113 "GET /compute/v2.1/servers/a041ef9e-83b8-4b8e-8ce7-8138654f603a" status: 200 len: 1318 microversion: 2.1 time: 0.174072 Jan 24 09:22:29.250328 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 417/846] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:22:29 2022] GET /compute/v2.1/servers/a041ef9e-83b8-4b8e-8ce7-8138654f603a => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:22:30.053563 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [req-9c322655-43b6-4684-a8ac-4fa4466deb0d req-c9966371-404e-462c-b56d-5f0c00d5fa45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a041ef9e-83b8-4b8e-8ce7-8138654f603a", "name": "network-vif-plugged", "status": "completed", "tag": "622af5fd-161f-45e6-9306-74b0695ac44b"}]} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:22:30.059546 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:22:30.059546 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: warnings.warn(msg) Jan 24 09:22:30.065121 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-ed740cdc-72d7-42b7-be2f-98eaa1209719 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:30.066068 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-ed740cdc-72d7-42b7-be2f-98eaa1209719 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:30.071355 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-9c322655-43b6-4684-a8ac-4fa4466deb0d req-c9966371-404e-462c-b56d-5f0c00d5fa45 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:30.072402 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-9c322655-43b6-4684-a8ac-4fa4466deb0d req-c9966371-404e-462c-b56d-5f0c00d5fa45 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:30.075433 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ed740cdc-72d7-42b7-be2f-98eaa1209719 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:30.076256 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ed740cdc-72d7-42b7-be2f-98eaa1209719 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:30.077314 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ed740cdc-72d7-42b7-be2f-98eaa1209719 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:30.077947 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ed740cdc-72d7-42b7-be2f-98eaa1209719 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:30.091652 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.compute.server_external_events [req-9c322655-43b6-4684-a8ac-4fa4466deb0d req-c9966371-404e-462c-b56d-5f0c00d5fa45 service nova] Creating event network-vif-plugged:622af5fd-161f-45e6-9306-74b0695ac44b for instance a041ef9e-83b8-4b8e-8ce7-8138654f603a on hv-cinder-80403 Jan 24 09:22:30.100530 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [req-9c322655-43b6-4684-a8ac-4fa4466deb0d req-c9966371-404e-462c-b56d-5f0c00d5fa45 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066841 Jan 24 09:22:30.100858 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 430/847] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:22:30.275400 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-ed740cdc-72d7-42b7-be2f-98eaa1209719 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:30.280265 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-ac4053e2-4783-43f4-b7a6-82671077d8f8 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:30.280265 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-ac4053e2-4783-43f4-b7a6-82671077d8f8 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] [instance: a041ef9e-83b8-4b8e-8ce7-8138654f603a] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:30.286529 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ac4053e2-4783-43f4-b7a6-82671077d8f8 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:30.286529 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ac4053e2-4783-43f4-b7a6-82671077d8f8 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:30.287042 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ac4053e2-4783-43f4-b7a6-82671077d8f8 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:30.287472 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ac4053e2-4783-43f4-b7a6-82671077d8f8 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:30.287829 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-ed740cdc-72d7-42b7-be2f-98eaa1209719 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:30.290916 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-ed740cdc-72d7-42b7-be2f-98eaa1209719 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:30.292089 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-ed740cdc-72d7-42b7-be2f-98eaa1209719 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1409 microversion: 2.20 time: 0.232761 Jan 24 09:22:30.292872 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 418/848] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:22:30 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1409 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:22:30.424218 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [req-deed54cb-a180-40c2-8722-e4b8379cafe6 req-42d0f173-76bd-4d07-b83f-6311569066ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab1e93a3-324f-47fc-b6ef-173b16f4e6f9", "tag": "11759d98-c43e-497b-a68d-7ce168a0cd80"}]} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:22:30.427252 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:22:30.427252 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: warnings.warn(msg) Jan 24 09:22:30.448452 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-deed54cb-a180-40c2-8722-e4b8379cafe6 req-42d0f173-76bd-4d07-b83f-6311569066ff service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:30.455139 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-deed54cb-a180-40c2-8722-e4b8379cafe6 req-42d0f173-76bd-4d07-b83f-6311569066ff service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:30.463469 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.compute.server_external_events [req-deed54cb-a180-40c2-8722-e4b8379cafe6 req-42d0f173-76bd-4d07-b83f-6311569066ff service nova] Creating event network-changed:11759d98-c43e-497b-a68d-7ce168a0cd80 for instance ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 on hv-cinder-80403 Jan 24 09:22:30.469270 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [req-deed54cb-a180-40c2-8722-e4b8379cafe6 req-42d0f173-76bd-4d07-b83f-6311569066ff service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049350 Jan 24 09:22:30.470068 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 419/849] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 09:22:30.590313 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-ac4053e2-4783-43f4-b7a6-82671077d8f8 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a041ed923e234b479a07afe629707504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3fa7c12b554a3bbfd918b6de58df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:30.600454 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-ac4053e2-4783-43f4-b7a6-82671077d8f8 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] 10.222.0.113 "GET /compute/v2.1/servers/a041ef9e-83b8-4b8e-8ce7-8138654f603a" status: 200 len: 1318 microversion: 2.1 time: 0.327755 Jan 24 09:22:30.601620 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 431/850] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:22:30 2022] GET /compute/v2.1/servers/a041ef9e-83b8-4b8e-8ce7-8138654f603a => generated 1318 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:22:31.311968 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-2f275f91-8473-4727-80f6-be550b4f3cf8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:31.312662 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-2f275f91-8473-4727-80f6-be550b4f3cf8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:31.319743 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2f275f91-8473-4727-80f6-be550b4f3cf8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:31.320192 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2f275f91-8473-4727-80f6-be550b4f3cf8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:31.320966 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2f275f91-8473-4727-80f6-be550b4f3cf8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:31.321425 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2f275f91-8473-4727-80f6-be550b4f3cf8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:31.456845 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-2f275f91-8473-4727-80f6-be550b4f3cf8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:31.465645 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-2f275f91-8473-4727-80f6-be550b4f3cf8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:31.467171 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-2f275f91-8473-4727-80f6-be550b4f3cf8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:31.468465 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-2f275f91-8473-4727-80f6-be550b4f3cf8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1409 microversion: 2.20 time: 0.160859 Jan 24 09:22:31.469204 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 420/851] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:22:31 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1409 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:22:31.619991 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-1c40395c-72c5-4e2b-b0f6-8f32042423bf tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:31.620987 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-1c40395c-72c5-4e2b-b0f6-8f32042423bf tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] [instance: a041ef9e-83b8-4b8e-8ce7-8138654f603a] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:31.628069 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1c40395c-72c5-4e2b-b0f6-8f32042423bf tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:31.628543 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1c40395c-72c5-4e2b-b0f6-8f32042423bf tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:31.629443 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1c40395c-72c5-4e2b-b0f6-8f32042423bf tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:31.630479 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1c40395c-72c5-4e2b-b0f6-8f32042423bf tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:31.764883 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-1c40395c-72c5-4e2b-b0f6-8f32042423bf tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a041ed923e234b479a07afe629707504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3fa7c12b554a3bbfd918b6de58df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:31.772819 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-1c40395c-72c5-4e2b-b0f6-8f32042423bf tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] 10.222.0.113 "GET /compute/v2.1/servers/a041ef9e-83b8-4b8e-8ce7-8138654f603a" status: 200 len: 1318 microversion: 2.1 time: 0.157683 Jan 24 09:22:31.773398 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 432/852] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:22:31 2022] GET /compute/v2.1/servers/a041ef9e-83b8-4b8e-8ce7-8138654f603a => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:22:32.488433 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-a2b0abd6-15bc-4a9f-8d22-16ebaf964d51 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:32.489112 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-a2b0abd6-15bc-4a9f-8d22-16ebaf964d51 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:32.496348 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a2b0abd6-15bc-4a9f-8d22-16ebaf964d51 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:32.496801 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a2b0abd6-15bc-4a9f-8d22-16ebaf964d51 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:32.497580 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a2b0abd6-15bc-4a9f-8d22-16ebaf964d51 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:32.498025 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a2b0abd6-15bc-4a9f-8d22-16ebaf964d51 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:32.638008 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-a2b0abd6-15bc-4a9f-8d22-16ebaf964d51 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:32.646592 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-a2b0abd6-15bc-4a9f-8d22-16ebaf964d51 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:32.648113 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-a2b0abd6-15bc-4a9f-8d22-16ebaf964d51 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:32.649214 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-a2b0abd6-15bc-4a9f-8d22-16ebaf964d51 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1409 microversion: 2.20 time: 0.164589 Jan 24 09:22:32.649779 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 421/853] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:22:32 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1409 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:22:32.789674 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-575094f1-5b96-46ce-a52a-f5e9a6e7780e tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:32.790516 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-575094f1-5b96-46ce-a52a-f5e9a6e7780e tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] [instance: a041ef9e-83b8-4b8e-8ce7-8138654f603a] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:32.796939 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-575094f1-5b96-46ce-a52a-f5e9a6e7780e tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:32.797382 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-575094f1-5b96-46ce-a52a-f5e9a6e7780e tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:32.798186 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-575094f1-5b96-46ce-a52a-f5e9a6e7780e tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:32.798618 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-575094f1-5b96-46ce-a52a-f5e9a6e7780e tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:32.937286 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-575094f1-5b96-46ce-a52a-f5e9a6e7780e tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a041ed923e234b479a07afe629707504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3fa7c12b554a3bbfd918b6de58df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:32.944912 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-575094f1-5b96-46ce-a52a-f5e9a6e7780e tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] 10.222.0.113 "GET /compute/v2.1/servers/a041ef9e-83b8-4b8e-8ce7-8138654f603a" status: 200 len: 1501 microversion: 2.1 time: 0.159616 Jan 24 09:22:32.945489 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 433/854] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:22:32 2022] GET /compute/v2.1/servers/a041ef9e-83b8-4b8e-8ce7-8138654f603a => generated 1501 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:22:33.667884 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-19854835-bcac-4743-99e6-b158cb97a7d6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:33.668434 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-19854835-bcac-4743-99e6-b158cb97a7d6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:33.675463 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-19854835-bcac-4743-99e6-b158cb97a7d6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:33.675906 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-19854835-bcac-4743-99e6-b158cb97a7d6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:33.677435 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-19854835-bcac-4743-99e6-b158cb97a7d6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:33.678064 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-19854835-bcac-4743-99e6-b158cb97a7d6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:33.773526 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-aa6e5371-3fc9-4e22-85ef-93b8b2200170 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:33.775508 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-aa6e5371-3fc9-4e22-85ef-93b8b2200170 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] [instance: a041ef9e-83b8-4b8e-8ce7-8138654f603a] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:33.784443 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-aa6e5371-3fc9-4e22-85ef-93b8b2200170 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:33.790015 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-aa6e5371-3fc9-4e22-85ef-93b8b2200170 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:33.794997 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-aa6e5371-3fc9-4e22-85ef-93b8b2200170 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:33.795549 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-aa6e5371-3fc9-4e22-85ef-93b8b2200170 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:33.841068 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-aa6e5371-3fc9-4e22-85ef-93b8b2200170 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] [instance: a041ef9e-83b8-4b8e-8ce7-8138654f603a] Going to try to terminate instance {{(pid=116863) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 09:22:33.841545 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-19854835-bcac-4743-99e6-b158cb97a7d6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:33.850044 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-19854835-bcac-4743-99e6-b158cb97a7d6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:33.851755 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-19854835-bcac-4743-99e6-b158cb97a7d6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:33.853146 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-19854835-bcac-4743-99e6-b158cb97a7d6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1409 microversion: 2.20 time: 0.188937 Jan 24 09:22:33.853706 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 422/855] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:22:33 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1409 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:22:34.168521 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-aa6e5371-3fc9-4e22-85ef-93b8b2200170 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] 10.222.0.113 "DELETE /compute/v2.1/servers/a041ef9e-83b8-4b8e-8ce7-8138654f603a" status: 204 len: 0 microversion: 2.1 time: 0.398614 Jan 24 09:22:34.169116 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 434/856] 10.222.0.113 () {58 vars in 1243 bytes} [Mon Jan 24 09:22:33 2022] DELETE /compute/v2.1/servers/a041ef9e-83b8-4b8e-8ce7-8138654f603a => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 24 09:22:34.177473 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-12d3b837-c44d-4bea-aec0-61ca5b8f3652 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:34.178114 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-12d3b837-c44d-4bea-aec0-61ca5b8f3652 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] [instance: a041ef9e-83b8-4b8e-8ce7-8138654f603a] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:34.184019 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-12d3b837-c44d-4bea-aec0-61ca5b8f3652 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:34.184404 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-12d3b837-c44d-4bea-aec0-61ca5b8f3652 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:34.185174 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-12d3b837-c44d-4bea-aec0-61ca5b8f3652 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:34.185603 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-12d3b837-c44d-4bea-aec0-61ca5b8f3652 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:34.318451 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-12d3b837-c44d-4bea-aec0-61ca5b8f3652 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a041ed923e234b479a07afe629707504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3fa7c12b554a3bbfd918b6de58df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:34.325780 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-12d3b837-c44d-4bea-aec0-61ca5b8f3652 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] 10.222.0.113 "GET /compute/v2.1/servers/a041ef9e-83b8-4b8e-8ce7-8138654f603a" status: 200 len: 1507 microversion: 2.1 time: 0.152099 Jan 24 09:22:34.326389 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 423/857] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:22:34 2022] GET /compute/v2.1/servers/a041ef9e-83b8-4b8e-8ce7-8138654f603a => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:22:34.872915 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-6fba2e11-a19e-427f-92ce-c15b8970671d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:34.873610 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-6fba2e11-a19e-427f-92ce-c15b8970671d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:34.881841 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6fba2e11-a19e-427f-92ce-c15b8970671d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:34.882336 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6fba2e11-a19e-427f-92ce-c15b8970671d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:34.883135 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6fba2e11-a19e-427f-92ce-c15b8970671d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:34.883648 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6fba2e11-a19e-427f-92ce-c15b8970671d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:35.032450 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-6fba2e11-a19e-427f-92ce-c15b8970671d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:35.040496 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-6fba2e11-a19e-427f-92ce-c15b8970671d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:35.041991 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-6fba2e11-a19e-427f-92ce-c15b8970671d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:35.043208 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-6fba2e11-a19e-427f-92ce-c15b8970671d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1409 microversion: 2.20 time: 0.174591 Jan 24 09:22:35.043799 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 435/858] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:22:34 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1409 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 09:22:35.343356 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-402f1e0d-4f36-4e24-99f9-5b129f8acb03 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:35.343961 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-402f1e0d-4f36-4e24-99f9-5b129f8acb03 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] [instance: a041ef9e-83b8-4b8e-8ce7-8138654f603a] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:35.351224 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-402f1e0d-4f36-4e24-99f9-5b129f8acb03 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:35.351618 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-402f1e0d-4f36-4e24-99f9-5b129f8acb03 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:35.352403 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-402f1e0d-4f36-4e24-99f9-5b129f8acb03 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:35.352837 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-402f1e0d-4f36-4e24-99f9-5b129f8acb03 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:35.490072 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-402f1e0d-4f36-4e24-99f9-5b129f8acb03 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a041ed923e234b479a07afe629707504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3fa7c12b554a3bbfd918b6de58df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:35.497643 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-402f1e0d-4f36-4e24-99f9-5b129f8acb03 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] 10.222.0.113 "GET /compute/v2.1/servers/a041ef9e-83b8-4b8e-8ce7-8138654f603a" status: 200 len: 1507 microversion: 2.1 time: 0.158017 Jan 24 09:22:35.498257 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 424/859] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:22:35 2022] GET /compute/v2.1/servers/a041ef9e-83b8-4b8e-8ce7-8138654f603a => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:22:35.980867 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [req-9f71028f-5377-422c-a0ca-6f7fda6b40e0 req-d375899e-2d78-468a-94a6-be18e4355a03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab1e93a3-324f-47fc-b6ef-173b16f4e6f9", "name": "network-vif-plugged", "status": "completed", "tag": "11759d98-c43e-497b-a68d-7ce168a0cd80"}]} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:22:35.980867 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:22:35.980867 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: warnings.warn(msg) Jan 24 09:22:35.986865 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-9f71028f-5377-422c-a0ca-6f7fda6b40e0 req-d375899e-2d78-468a-94a6-be18e4355a03 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:35.987304 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-9f71028f-5377-422c-a0ca-6f7fda6b40e0 req-d375899e-2d78-468a-94a6-be18e4355a03 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:35.998534 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.compute.server_external_events [req-9f71028f-5377-422c-a0ca-6f7fda6b40e0 req-d375899e-2d78-468a-94a6-be18e4355a03 service nova] Creating event network-vif-plugged:11759d98-c43e-497b-a68d-7ce168a0cd80 for instance ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 on hv-cinder-80403 Jan 24 09:22:36.003288 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [req-9f71028f-5377-422c-a0ca-6f7fda6b40e0 req-d375899e-2d78-468a-94a6-be18e4355a03 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029917 Jan 24 09:22:36.006885 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 436/860] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:22:36.062121 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-2cdd8438-80e9-4221-8a72-1ae361034590 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:36.062471 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-2cdd8438-80e9-4221-8a72-1ae361034590 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:36.069867 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2cdd8438-80e9-4221-8a72-1ae361034590 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:36.070156 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2cdd8438-80e9-4221-8a72-1ae361034590 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:36.070809 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2cdd8438-80e9-4221-8a72-1ae361034590 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:36.071242 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2cdd8438-80e9-4221-8a72-1ae361034590 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:36.218724 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-2cdd8438-80e9-4221-8a72-1ae361034590 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:36.227608 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-2cdd8438-80e9-4221-8a72-1ae361034590 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:36.229106 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-2cdd8438-80e9-4221-8a72-1ae361034590 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:36.230246 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-2cdd8438-80e9-4221-8a72-1ae361034590 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1409 microversion: 2.20 time: 0.172388 Jan 24 09:22:36.230816 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 425/861] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:22:36 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1409 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:22:36.515756 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-c48b195d-0374-49d9-9540-dd8385ac9303 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:36.516388 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-c48b195d-0374-49d9-9540-dd8385ac9303 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] [instance: a041ef9e-83b8-4b8e-8ce7-8138654f603a] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:36.522932 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c48b195d-0374-49d9-9540-dd8385ac9303 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:36.523616 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c48b195d-0374-49d9-9540-dd8385ac9303 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:36.524590 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c48b195d-0374-49d9-9540-dd8385ac9303 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:36.525055 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c48b195d-0374-49d9-9540-dd8385ac9303 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:36.774525 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-c48b195d-0374-49d9-9540-dd8385ac9303 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a041ed923e234b479a07afe629707504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3fa7c12b554a3bbfd918b6de58df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:36.781956 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-c48b195d-0374-49d9-9540-dd8385ac9303 tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] 10.222.0.113 "GET /compute/v2.1/servers/a041ef9e-83b8-4b8e-8ce7-8138654f603a" status: 200 len: 1507 microversion: 2.1 time: 0.270561 Jan 24 09:22:36.782554 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 437/862] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:22:36 2022] GET /compute/v2.1/servers/a041ef9e-83b8-4b8e-8ce7-8138654f603a => generated 1507 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:22:37.049305 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [req-73b12dcb-0b8a-4dac-bdec-4456f756fa08 req-3687521c-25ac-4198-ba81-7b9e769f61bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a041ef9e-83b8-4b8e-8ce7-8138654f603a", "name": "network-vif-deleted", "tag": "622af5fd-161f-45e6-9306-74b0695ac44b"}]} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:22:37.050913 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:22:37.050913 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: warnings.warn(msg) Jan 24 09:22:37.058614 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-73b12dcb-0b8a-4dac-bdec-4456f756fa08 req-3687521c-25ac-4198-ba81-7b9e769f61bd service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:37.059050 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-73b12dcb-0b8a-4dac-bdec-4456f756fa08 req-3687521c-25ac-4198-ba81-7b9e769f61bd service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:37.070788 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.compute.server_external_events [req-73b12dcb-0b8a-4dac-bdec-4456f756fa08 req-3687521c-25ac-4198-ba81-7b9e769f61bd service nova] Creating event network-vif-deleted:622af5fd-161f-45e6-9306-74b0695ac44b for instance a041ef9e-83b8-4b8e-8ce7-8138654f603a on hv-cinder-80403 Jan 24 09:22:37.075727 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [req-73b12dcb-0b8a-4dac-bdec-4456f756fa08 req-3687521c-25ac-4198-ba81-7b9e769f61bd service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153249 Jan 24 09:22:37.076314 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 426/863] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:22:37.249519 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-53260ef3-cbe7-401b-abf3-d0ab7d1d4173 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:37.250193 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-53260ef3-cbe7-401b-abf3-d0ab7d1d4173 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:37.256691 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-53260ef3-cbe7-401b-abf3-d0ab7d1d4173 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:37.257195 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-53260ef3-cbe7-401b-abf3-d0ab7d1d4173 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:37.257924 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-53260ef3-cbe7-401b-abf3-d0ab7d1d4173 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:37.258389 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-53260ef3-cbe7-401b-abf3-d0ab7d1d4173 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:37.406872 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-53260ef3-cbe7-401b-abf3-d0ab7d1d4173 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:37.415337 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-53260ef3-cbe7-401b-abf3-d0ab7d1d4173 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:37.418181 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-53260ef3-cbe7-401b-abf3-d0ab7d1d4173 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:37.418181 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-53260ef3-cbe7-401b-abf3-d0ab7d1d4173 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1409 microversion: 2.20 time: 0.173133 Jan 24 09:22:37.418671 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 438/864] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:22:37 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1409 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 09:22:37.802842 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-4634b774-9680-402f-a9e1-d652971fffbb tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:37.803557 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-4634b774-9680-402f-a9e1-d652971fffbb tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] [instance: a041ef9e-83b8-4b8e-8ce7-8138654f603a] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:37.810821 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4634b774-9680-402f-a9e1-d652971fffbb tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:37.811278 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4634b774-9680-402f-a9e1-d652971fffbb tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:37.812073 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4634b774-9680-402f-a9e1-d652971fffbb tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:37.812521 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4634b774-9680-402f-a9e1-d652971fffbb tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:37.855294 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4634b774-9680-402f-a9e1-d652971fffbb tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:37.855746 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4634b774-9680-402f-a9e1-d652971fffbb tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:37.856193 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.objects.instance [None req-4634b774-9680-402f-a9e1-d652971fffbb tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lazy-loading 'fault' on Instance uuid a041ef9e-83b8-4b8e-8ce7-8138654f603a {{(pid=116864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 09:22:37.898579 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-4634b774-9680-402f-a9e1-d652971fffbb tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a041ed923e234b479a07afe629707504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3fa7c12b554a3bbfd918b6de58df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:37.904835 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-4634b774-9680-402f-a9e1-d652971fffbb tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] 10.222.0.113 "GET /compute/v2.1/servers/a041ef9e-83b8-4b8e-8ce7-8138654f603a" status: 200 len: 1308 microversion: 2.1 time: 0.107379 Jan 24 09:22:37.905425 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 427/865] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:22:37 2022] GET /compute/v2.1/servers/a041ef9e-83b8-4b8e-8ce7-8138654f603a => generated 1308 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:22:38.438991 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-0fbb957b-0248-424a-b9a6-a2ab7244e0ed tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:38.440229 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-0fbb957b-0248-424a-b9a6-a2ab7244e0ed tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:38.450309 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0fbb957b-0248-424a-b9a6-a2ab7244e0ed tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:38.450744 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0fbb957b-0248-424a-b9a6-a2ab7244e0ed tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:38.451564 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0fbb957b-0248-424a-b9a6-a2ab7244e0ed tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:38.452001 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0fbb957b-0248-424a-b9a6-a2ab7244e0ed tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:38.619085 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-0fbb957b-0248-424a-b9a6-a2ab7244e0ed tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:38.629367 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-0fbb957b-0248-424a-b9a6-a2ab7244e0ed tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:38.630923 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-0fbb957b-0248-424a-b9a6-a2ab7244e0ed tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:22:38.632137 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-0fbb957b-0248-424a-b9a6-a2ab7244e0ed tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1601 microversion: 2.20 time: 0.197546 Jan 24 09:22:38.632709 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 439/866] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:22:38 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1601 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:22:38.650196 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-262d34c5-3a3a-4708-b943-90c50b42ad78 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:38.653724 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-262d34c5-3a3a-4708-b943-90c50b42ad78 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:38.657196 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-262d34c5-3a3a-4708-b943-90c50b42ad78 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:38.657645 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-262d34c5-3a3a-4708-b943-90c50b42ad78 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:38.658475 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-262d34c5-3a3a-4708-b943-90c50b42ad78 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:38.658914 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-262d34c5-3a3a-4708-b943-90c50b42ad78 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:38.750219 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-262d34c5-3a3a-4708-b943-90c50b42ad78 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.104321 Jan 24 09:22:38.750818 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 428/867] 10.222.0.113 () {60 vars in 1320 bytes} [Mon Jan 24 09:22:38 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:22:38.922000 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-adb1f8f4-ddca-4543-912e-115f1449986a tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:22:38.922836 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-adb1f8f4-ddca-4543-912e-115f1449986a tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] [instance: a041ef9e-83b8-4b8e-8ce7-8138654f603a] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:38.930063 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-adb1f8f4-ddca-4543-912e-115f1449986a tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:38.930552 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-adb1f8f4-ddca-4543-912e-115f1449986a tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:38.931340 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-adb1f8f4-ddca-4543-912e-115f1449986a tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:38.931860 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-adb1f8f4-ddca-4543-912e-115f1449986a tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:38.945526 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.wsgi [None req-adb1f8f4-ddca-4543-912e-115f1449986a tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] HTTP exception thrown: Instance a041ef9e-83b8-4b8e-8ce7-8138654f603a could not be found. Jan 24 09:22:38.946186 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-adb1f8f4-ddca-4543-912e-115f1449986a tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] Returning 404 to user: Instance a041ef9e-83b8-4b8e-8ce7-8138654f603a could not be found. {{(pid=116863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:22:38.947016 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-adb1f8f4-ddca-4543-912e-115f1449986a tempest-VolumesActionsTest-2110202165 tempest-VolumesActionsTest-2110202165-project] 10.222.0.113 "GET /compute/v2.1/servers/a041ef9e-83b8-4b8e-8ce7-8138654f603a" status: 404 len: 111 microversion: 2.1 time: 0.029076 Jan 24 09:22:38.947564 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 440/868] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:22:38 2022] GET /compute/v2.1/servers/a041ef9e-83b8-4b8e-8ce7-8138654f603a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 09:22:40.078157 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-b1c5b9d9-ba25-491a-a280-79e1caad24f7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:22:40.079228 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-b1c5b9d9-ba25-491a-a280-79e1caad24f7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:40.085961 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b1c5b9d9-ba25-491a-a280-79e1caad24f7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:40.086469 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b1c5b9d9-ba25-491a-a280-79e1caad24f7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:40.087745 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b1c5b9d9-ba25-491a-a280-79e1caad24f7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:40.088289 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b1c5b9d9-ba25-491a-a280-79e1caad24f7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:40.164101 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-b1c5b9d9-ba25-491a-a280-79e1caad24f7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action" status: 200 len: 14 microversion: 2.20 time: 0.090059 Jan 24 09:22:40.168240 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 429/869] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:22:40 2022] POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:22:40.180863 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [req-4c751c64-49b1-4121-93d7-893c3a2a4013 req-3805e071-2bfe-4dd8-9d28-6909aad1fcf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab1e93a3-324f-47fc-b6ef-173b16f4e6f9", "tag": "11759d98-c43e-497b-a68d-7ce168a0cd80"}]} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:22:40.183897 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:22:40.183897 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: warnings.warn(msg) Jan 24 09:22:40.191275 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-4c751c64-49b1-4121-93d7-893c3a2a4013 req-3805e071-2bfe-4dd8-9d28-6909aad1fcf3 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:40.191518 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-4c751c64-49b1-4121-93d7-893c3a2a4013 req-3805e071-2bfe-4dd8-9d28-6909aad1fcf3 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:40.204703 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.compute.server_external_events [req-4c751c64-49b1-4121-93d7-893c3a2a4013 req-3805e071-2bfe-4dd8-9d28-6909aad1fcf3 service nova] Creating event network-changed:11759d98-c43e-497b-a68d-7ce168a0cd80 for instance ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 on hv-cinder-80403 Jan 24 09:22:40.210643 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [req-4c751c64-49b1-4121-93d7-893c3a2a4013 req-3805e071-2bfe-4dd8-9d28-6909aad1fcf3 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134671 Jan 24 09:22:40.211483 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 441/870] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 09:22:41.177592 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-71cf4c89-ee2f-4442-82aa-b7f14210f580 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:22:41.178659 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-71cf4c89-ee2f-4442-82aa-b7f14210f580 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:41.185876 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-71cf4c89-ee2f-4442-82aa-b7f14210f580 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:41.186431 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-71cf4c89-ee2f-4442-82aa-b7f14210f580 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:41.187295 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-71cf4c89-ee2f-4442-82aa-b7f14210f580 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:41.187810 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-71cf4c89-ee2f-4442-82aa-b7f14210f580 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:43.432396 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-71cf4c89-ee2f-4442-82aa-b7f14210f580 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action" status: 200 len: 14 microversion: 2.20 time: 2.259615 Jan 24 09:22:43.436005 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 430/871] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:22:41 2022] POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action => generated 14 bytes in 2264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:22:44.450875 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-2d7ccbc1-9691-4bc6-9d61-284ffb059d3f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:22:44.450875 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-2d7ccbc1-9691-4bc6-9d61-284ffb059d3f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:44.451782 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-2d7ccbc1-9691-4bc6-9d61-284ffb059d3f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:44.452233 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-2d7ccbc1-9691-4bc6-9d61-284ffb059d3f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:44.453028 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-2d7ccbc1-9691-4bc6-9d61-284ffb059d3f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:44.453465 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-2d7ccbc1-9691-4bc6-9d61-284ffb059d3f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:44.519487 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-2d7ccbc1-9691-4bc6-9d61-284ffb059d3f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action" status: 200 len: 14 microversion: 2.20 time: 0.079566 Jan 24 09:22:44.521077 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 442/872] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:22:44 2022] POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:22:45.532842 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-58ace9c2-a172-4c5a-81ff-3b5e801e8ed3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:22:45.534854 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-58ace9c2-a172-4c5a-81ff-3b5e801e8ed3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:45.551793 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-58ace9c2-a172-4c5a-81ff-3b5e801e8ed3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:45.552538 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-58ace9c2-a172-4c5a-81ff-3b5e801e8ed3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:45.553630 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-58ace9c2-a172-4c5a-81ff-3b5e801e8ed3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:45.553970 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-58ace9c2-a172-4c5a-81ff-3b5e801e8ed3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:45.662934 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-58ace9c2-a172-4c5a-81ff-3b5e801e8ed3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action" status: 200 len: 14 microversion: 2.20 time: 0.133804 Jan 24 09:22:45.666014 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 431/873] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:22:45 2022] POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action => generated 14 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:22:46.679710 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-b4aff1a3-749a-4858-ace1-5f929d8da26d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:22:46.680685 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-b4aff1a3-749a-4858-ace1-5f929d8da26d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:46.687771 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b4aff1a3-749a-4858-ace1-5f929d8da26d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:46.688555 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b4aff1a3-749a-4858-ace1-5f929d8da26d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:46.689616 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b4aff1a3-749a-4858-ace1-5f929d8da26d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:46.690281 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b4aff1a3-749a-4858-ace1-5f929d8da26d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:46.767333 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-b4aff1a3-749a-4858-ace1-5f929d8da26d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action" status: 200 len: 14 microversion: 2.20 time: 0.092821 Jan 24 09:22:46.771669 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 443/874] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:22:46 2022] POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:22:47.780215 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-6babaa6c-7f76-4e66-bf9b-b83cf75029d4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:22:47.781120 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-6babaa6c-7f76-4e66-bf9b-b83cf75029d4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:47.789951 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6babaa6c-7f76-4e66-bf9b-b83cf75029d4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:47.790640 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6babaa6c-7f76-4e66-bf9b-b83cf75029d4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:47.791448 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6babaa6c-7f76-4e66-bf9b-b83cf75029d4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:47.791910 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6babaa6c-7f76-4e66-bf9b-b83cf75029d4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:47.859122 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-6babaa6c-7f76-4e66-bf9b-b83cf75029d4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action" status: 200 len: 14 microversion: 2.20 time: 0.083428 Jan 24 09:22:47.859837 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 432/875] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:22:47 2022] POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:22:48.874717 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-a6626c56-aba9-473d-946b-b4cc720c928e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:22:48.882266 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-a6626c56-aba9-473d-946b-b4cc720c928e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:48.890896 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a6626c56-aba9-473d-946b-b4cc720c928e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:48.891637 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a6626c56-aba9-473d-946b-b4cc720c928e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:48.892701 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a6626c56-aba9-473d-946b-b4cc720c928e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:48.893295 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a6626c56-aba9-473d-946b-b4cc720c928e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:48.985340 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-a6626c56-aba9-473d-946b-b4cc720c928e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action" status: 200 len: 14 microversion: 2.20 time: 0.117638 Jan 24 09:22:48.986385 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 444/876] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:22:48 2022] POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:22:50.002408 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-a98b96a0-9b12-450d-ac4d-0d01380fd1cd tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:22:50.005675 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-a98b96a0-9b12-450d-ac4d-0d01380fd1cd tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:50.015467 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a98b96a0-9b12-450d-ac4d-0d01380fd1cd tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:50.016057 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a98b96a0-9b12-450d-ac4d-0d01380fd1cd tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:50.017334 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a98b96a0-9b12-450d-ac4d-0d01380fd1cd tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:50.017949 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a98b96a0-9b12-450d-ac4d-0d01380fd1cd tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:50.103266 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-a98b96a0-9b12-450d-ac4d-0d01380fd1cd tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action" status: 200 len: 14 microversion: 2.20 time: 0.107539 Jan 24 09:22:50.105057 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 433/877] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:22:49 2022] POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:22:51.120568 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-c84defcf-ebcb-495c-a120-5bd3f8b358b2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:22:51.121745 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-c84defcf-ebcb-495c-a120-5bd3f8b358b2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:51.130979 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c84defcf-ebcb-495c-a120-5bd3f8b358b2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:51.131594 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c84defcf-ebcb-495c-a120-5bd3f8b358b2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:51.132605 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c84defcf-ebcb-495c-a120-5bd3f8b358b2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:51.133120 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c84defcf-ebcb-495c-a120-5bd3f8b358b2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:51.216601 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-c84defcf-ebcb-495c-a120-5bd3f8b358b2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action" status: 200 len: 14 microversion: 2.20 time: 0.099916 Jan 24 09:22:51.217345 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 445/878] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:22:51 2022] POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:22:52.233760 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-928c4a3c-384e-4f39-9e33-8a05c29fef70 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:22:52.234991 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-928c4a3c-384e-4f39-9e33-8a05c29fef70 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:52.242784 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-928c4a3c-384e-4f39-9e33-8a05c29fef70 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:52.243350 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-928c4a3c-384e-4f39-9e33-8a05c29fef70 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:52.244196 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-928c4a3c-384e-4f39-9e33-8a05c29fef70 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:52.244698 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-928c4a3c-384e-4f39-9e33-8a05c29fef70 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:54.147662 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-928c4a3c-384e-4f39-9e33-8a05c29fef70 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action" status: 200 len: 14 microversion: 2.20 time: 1.921023 Jan 24 09:22:54.148358 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 434/879] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:22:52 2022] POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action => generated 14 bytes in 1923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:22:55.159410 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-3f571e9b-d621-40cb-9e5f-3e6b80631722 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:22:55.174855 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-3f571e9b-d621-40cb-9e5f-3e6b80631722 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:55.174855 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3f571e9b-d621-40cb-9e5f-3e6b80631722 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:55.174855 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3f571e9b-d621-40cb-9e5f-3e6b80631722 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:55.174855 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3f571e9b-d621-40cb-9e5f-3e6b80631722 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:55.176459 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3f571e9b-d621-40cb-9e5f-3e6b80631722 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:55.249068 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-3f571e9b-d621-40cb-9e5f-3e6b80631722 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action" status: 200 len: 14 microversion: 2.20 time: 0.093192 Jan 24 09:22:55.253837 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 446/880] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:22:55 2022] POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:22:56.268216 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-1d360547-08fd-4ac6-8b8f-6c362b067c6d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:22:56.270561 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-1d360547-08fd-4ac6-8b8f-6c362b067c6d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:56.283545 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1d360547-08fd-4ac6-8b8f-6c362b067c6d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:56.285333 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1d360547-08fd-4ac6-8b8f-6c362b067c6d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:56.287403 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1d360547-08fd-4ac6-8b8f-6c362b067c6d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:56.288444 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1d360547-08fd-4ac6-8b8f-6c362b067c6d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:56.375770 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-1d360547-08fd-4ac6-8b8f-6c362b067c6d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action" status: 200 len: 14 microversion: 2.20 time: 0.113641 Jan 24 09:22:56.377389 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 435/881] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:22:56 2022] POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:22:57.389568 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-7d925799-52c0-41da-af7c-253199aa2a2d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:22:57.390599 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-7d925799-52c0-41da-af7c-253199aa2a2d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:57.397855 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7d925799-52c0-41da-af7c-253199aa2a2d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:57.398341 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7d925799-52c0-41da-af7c-253199aa2a2d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:57.399120 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7d925799-52c0-41da-af7c-253199aa2a2d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:57.399546 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7d925799-52c0-41da-af7c-253199aa2a2d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:57.485278 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-7d925799-52c0-41da-af7c-253199aa2a2d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action" status: 200 len: 10009 microversion: 2.20 time: 0.099599 Jan 24 09:22:57.485937 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 447/882] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:22:57 2022] POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action => generated 10009 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 09:22:58.497583 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-92111f9b-0427-4fc6-b14a-25fe9b725dff tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:22:58.498892 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-92111f9b-0427-4fc6-b14a-25fe9b725dff tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:58.506739 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-92111f9b-0427-4fc6-b14a-25fe9b725dff tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:58.507583 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-92111f9b-0427-4fc6-b14a-25fe9b725dff tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:58.508638 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-92111f9b-0427-4fc6-b14a-25fe9b725dff tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:58.509325 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-92111f9b-0427-4fc6-b14a-25fe9b725dff tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:58.596834 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-92111f9b-0427-4fc6-b14a-25fe9b725dff tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action" status: 200 len: 15025 microversion: 2.20 time: 0.102773 Jan 24 09:22:58.602161 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 436/883] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:22:58 2022] POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action => generated 15025 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:22:59.611296 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-41127b56-ba30-4575-8962-1e98dfa91020 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:22:59.612343 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-41127b56-ba30-4575-8962-1e98dfa91020 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:22:59.629556 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-41127b56-ba30-4575-8962-1e98dfa91020 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:59.630015 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-41127b56-ba30-4575-8962-1e98dfa91020 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:59.630850 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-41127b56-ba30-4575-8962-1e98dfa91020 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:22:59.631292 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-41127b56-ba30-4575-8962-1e98dfa91020 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:22:59.727935 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-41127b56-ba30-4575-8962-1e98dfa91020 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action" status: 200 len: 17984 microversion: 2.20 time: 0.117020 Jan 24 09:22:59.727935 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 448/884] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:22:59 2022] POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action => generated 17984 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:23:00.736690 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-84cb600f-9673-45ec-9abb-5b42ec5f7c74 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:00.738409 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-84cb600f-9673-45ec-9abb-5b42ec5f7c74 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:00.746088 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-84cb600f-9673-45ec-9abb-5b42ec5f7c74 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:00.746560 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-84cb600f-9673-45ec-9abb-5b42ec5f7c74 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:00.747455 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-84cb600f-9673-45ec-9abb-5b42ec5f7c74 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:00.747937 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-84cb600f-9673-45ec-9abb-5b42ec5f7c74 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:03.149714 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-84cb600f-9673-45ec-9abb-5b42ec5f7c74 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action" status: 200 len: 22981 microversion: 2.20 time: 2.417315 Jan 24 09:23:03.150482 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 437/885] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:23:00 2022] POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action => generated 22981 bytes in 2419 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:23:04.164575 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-8470a460-8b76-431e-9a40-6ab63d0941c4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:04.165758 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-8470a460-8b76-431e-9a40-6ab63d0941c4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:04.173717 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8470a460-8b76-431e-9a40-6ab63d0941c4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:04.174209 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8470a460-8b76-431e-9a40-6ab63d0941c4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:04.175162 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8470a460-8b76-431e-9a40-6ab63d0941c4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:04.175600 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8470a460-8b76-431e-9a40-6ab63d0941c4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:04.227623 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-7e1e9dd3-2298-40c6-a0e1-eb014b70ef45 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:04.228626 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-7e1e9dd3-2298-40c6-a0e1-eb014b70ef45 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:04.236084 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-7e1e9dd3-2298-40c6-a0e1-eb014b70ef45 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:04.236532 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-7e1e9dd3-2298-40c6-a0e1-eb014b70ef45 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:04.237309 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-7e1e9dd3-2298-40c6-a0e1-eb014b70ef45 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:04.237747 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-7e1e9dd3-2298-40c6-a0e1-eb014b70ef45 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:04.256704 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-8470a460-8b76-431e-9a40-6ab63d0941c4 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action" status: 200 len: 23804 microversion: 2.20 time: 0.096405 Jan 24 09:23:04.258347 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 449/886] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:23:04 2022] POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action => generated 23804 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:23:04.269570 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-7e1e9dd3-2298-40c6-a0e1-eb014b70ef45 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046840 Jan 24 09:23:04.270944 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 438/887] 10.222.0.113 () {58 vars in 1306 bytes} [Mon Jan 24 09:23:04 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 24 09:23:04.343882 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-fbc0484c-7e51-4f9b-9f0f-4814ea3f0693 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:04.344876 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-fbc0484c-7e51-4f9b-9f0f-4814ea3f0693 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:04.354842 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-fbc0484c-7e51-4f9b-9f0f-4814ea3f0693 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:04.355398 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-fbc0484c-7e51-4f9b-9f0f-4814ea3f0693 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:04.356467 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-fbc0484c-7e51-4f9b-9f0f-4814ea3f0693 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:04.357242 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-fbc0484c-7e51-4f9b-9f0f-4814ea3f0693 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:04.388688 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-fbc0484c-7e51-4f9b-9f0f-4814ea3f0693 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Going to try to terminate instance {{(pid=116863) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 09:23:04.787178 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-fbc0484c-7e51-4f9b-9f0f-4814ea3f0693 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "DELETE /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 204 len: 0 microversion: 2.1 time: 0.449351 Jan 24 09:23:04.788653 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 450/888] 10.222.0.113 () {58 vars in 1243 bytes} [Mon Jan 24 09:23:04 2022] DELETE /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 24 09:23:04.796253 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-f3d260b9-64ab-44db-bd6b-03c6dae53054 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:04.796861 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-f3d260b9-64ab-44db-bd6b-03c6dae53054 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:04.803338 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f3d260b9-64ab-44db-bd6b-03c6dae53054 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:04.803791 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f3d260b9-64ab-44db-bd6b-03c6dae53054 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:04.804568 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f3d260b9-64ab-44db-bd6b-03c6dae53054 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:04.805004 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f3d260b9-64ab-44db-bd6b-03c6dae53054 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:04.943055 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-f3d260b9-64ab-44db-bd6b-03c6dae53054 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:04.950298 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-f3d260b9-64ab-44db-bd6b-03c6dae53054 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1676 microversion: 2.1 time: 0.157979 Jan 24 09:23:04.950879 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 439/889] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:04 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:23:05.268934 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-a895f91c-c172-4379-876b-989ed64a560f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:05.270676 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-a895f91c-c172-4379-876b-989ed64a560f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:05.278515 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a895f91c-c172-4379-876b-989ed64a560f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:05.279903 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a895f91c-c172-4379-876b-989ed64a560f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:05.279903 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a895f91c-c172-4379-876b-989ed64a560f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:05.280149 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a895f91c-c172-4379-876b-989ed64a560f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:05.361831 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-a895f91c-c172-4379-876b-989ed64a560f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action" status: 200 len: 25089 microversion: 2.20 time: 0.096691 Jan 24 09:23:05.362813 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 451/890] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:23:05 2022] POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action => generated 25089 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:23:05.967958 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-1a27a6bb-2d2c-4775-83cc-df1e541468c9 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:05.968570 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-1a27a6bb-2d2c-4775-83cc-df1e541468c9 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:05.975901 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1a27a6bb-2d2c-4775-83cc-df1e541468c9 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:05.976373 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1a27a6bb-2d2c-4775-83cc-df1e541468c9 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:05.977230 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1a27a6bb-2d2c-4775-83cc-df1e541468c9 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:05.977662 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1a27a6bb-2d2c-4775-83cc-df1e541468c9 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:06.107810 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-1a27a6bb-2d2c-4775-83cc-df1e541468c9 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:06.115734 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-1a27a6bb-2d2c-4775-83cc-df1e541468c9 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1676 microversion: 2.1 time: 0.151508 Jan 24 09:23:06.116302 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 440/891] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:05 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:23:06.374753 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-97f54c34-1f9f-4621-b1b6-437210835d97 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:06.375769 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-97f54c34-1f9f-4621-b1b6-437210835d97 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:06.382574 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-97f54c34-1f9f-4621-b1b6-437210835d97 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:06.383028 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-97f54c34-1f9f-4621-b1b6-437210835d97 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:06.383821 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-97f54c34-1f9f-4621-b1b6-437210835d97 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:06.384251 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-97f54c34-1f9f-4621-b1b6-437210835d97 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:06.467114 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-97f54c34-1f9f-4621-b1b6-437210835d97 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action" status: 200 len: 26166 microversion: 2.20 time: 0.096759 Jan 24 09:23:06.467953 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 452/892] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:23:06 2022] POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action => generated 26166 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:23:07.133584 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-62877a2b-c9ce-4572-b4e3-b816ed320834 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:07.134233 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-62877a2b-c9ce-4572-b4e3-b816ed320834 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:07.170993 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-62877a2b-c9ce-4572-b4e3-b816ed320834 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:07.170993 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-62877a2b-c9ce-4572-b4e3-b816ed320834 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:07.170993 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-62877a2b-c9ce-4572-b4e3-b816ed320834 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:07.170993 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-62877a2b-c9ce-4572-b4e3-b816ed320834 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:07.211367 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-62877a2b-c9ce-4572-b4e3-b816ed320834 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:07.219100 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-62877a2b-c9ce-4572-b4e3-b816ed320834 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1609 microversion: 2.1 time: 0.089581 Jan 24 09:23:07.219680 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 441/893] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:07 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1609 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:23:07.415489 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [req-81767301-f6f2-429e-b0ba-4735fdab90e5 req-16e7d6d5-fbbe-4118-a9fe-3a31c309343a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7421454-e5c9-4ecb-8afb-928a7042b789", "name": "network-vif-deleted", "tag": "93c2fd64-23e2-4383-a6ab-b95fd9eca7df"}]} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:07.425019 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:23:07.425019 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: warnings.warn(msg) Jan 24 09:23:07.425360 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-81767301-f6f2-429e-b0ba-4735fdab90e5 req-16e7d6d5-fbbe-4118-a9fe-3a31c309343a service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:07.425819 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-81767301-f6f2-429e-b0ba-4735fdab90e5 req-16e7d6d5-fbbe-4118-a9fe-3a31c309343a service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:07.440656 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.compute.server_external_events [req-81767301-f6f2-429e-b0ba-4735fdab90e5 req-16e7d6d5-fbbe-4118-a9fe-3a31c309343a service nova] Creating event network-vif-deleted:93c2fd64-23e2-4383-a6ab-b95fd9eca7df for instance c7421454-e5c9-4ecb-8afb-928a7042b789 on hv-cinder-80403 Jan 24 09:23:07.450376 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [req-81767301-f6f2-429e-b0ba-4735fdab90e5 req-16e7d6d5-fbbe-4118-a9fe-3a31c309343a service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039640 Jan 24 09:23:07.456879 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 453/894] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:23:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:23:07.480519 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-e799588a-8842-4a70-aadf-836db00a2112 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:07.481793 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-e799588a-8842-4a70-aadf-836db00a2112 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:07.488530 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e799588a-8842-4a70-aadf-836db00a2112 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:07.490956 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e799588a-8842-4a70-aadf-836db00a2112 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:07.490956 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e799588a-8842-4a70-aadf-836db00a2112 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:07.491294 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e799588a-8842-4a70-aadf-836db00a2112 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:07.607758 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-e799588a-8842-4a70-aadf-836db00a2112 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action" status: 200 len: 27131 microversion: 2.20 time: 0.131839 Jan 24 09:23:07.613007 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 442/895] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:23:07 2022] POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action => generated 27131 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:23:08.237706 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-42ce3fca-0abc-4a81-90cb-e8bd14d2e31d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:08.241509 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-42ce3fca-0abc-4a81-90cb-e8bd14d2e31d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:08.245471 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-42ce3fca-0abc-4a81-90cb-e8bd14d2e31d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:08.245916 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-42ce3fca-0abc-4a81-90cb-e8bd14d2e31d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:08.246746 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-42ce3fca-0abc-4a81-90cb-e8bd14d2e31d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:08.247181 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-42ce3fca-0abc-4a81-90cb-e8bd14d2e31d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:08.282263 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-42ce3fca-0abc-4a81-90cb-e8bd14d2e31d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:08.282263 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-42ce3fca-0abc-4a81-90cb-e8bd14d2e31d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:08.282263 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.objects.instance [None req-42ce3fca-0abc-4a81-90cb-e8bd14d2e31d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lazy-loading 'fault' on Instance uuid c7421454-e5c9-4ecb-8afb-928a7042b789 {{(pid=116863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 09:23:08.333282 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-42ce3fca-0abc-4a81-90cb-e8bd14d2e31d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:08.341889 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-42ce3fca-0abc-4a81-90cb-e8bd14d2e31d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 200 len: 1331 microversion: 2.1 time: 0.108588 Jan 24 09:23:08.350430 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 454/896] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:08 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 1331 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:23:08.626837 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-d89cc8a8-d6b4-4974-8c35-ab008b8168f7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:08.628642 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-d89cc8a8-d6b4-4974-8c35-ab008b8168f7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:08.636709 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d89cc8a8-d6b4-4974-8c35-ab008b8168f7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:08.637432 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d89cc8a8-d6b4-4974-8c35-ab008b8168f7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:08.638269 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d89cc8a8-d6b4-4974-8c35-ab008b8168f7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:08.638881 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d89cc8a8-d6b4-4974-8c35-ab008b8168f7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:08.723978 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-d89cc8a8-d6b4-4974-8c35-ab008b8168f7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action" status: 200 len: 27701 microversion: 2.20 time: 0.102562 Jan 24 09:23:08.725361 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 443/897] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:23:08 2022] POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action => generated 27701 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:23:09.367745 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-5252be80-45e4-480c-a9f8-509ead9830c1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:09.368418 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-5252be80-45e4-480c-a9f8-509ead9830c1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:09.374355 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5252be80-45e4-480c-a9f8-509ead9830c1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:09.374807 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5252be80-45e4-480c-a9f8-509ead9830c1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:09.375581 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5252be80-45e4-480c-a9f8-509ead9830c1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:09.376018 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5252be80-45e4-480c-a9f8-509ead9830c1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:09.391078 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.wsgi [None req-5252be80-45e4-480c-a9f8-509ead9830c1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] HTTP exception thrown: Instance c7421454-e5c9-4ecb-8afb-928a7042b789 could not be found. Jan 24 09:23:09.391685 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-5252be80-45e4-480c-a9f8-509ead9830c1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Returning 404 to user: Instance c7421454-e5c9-4ecb-8afb-928a7042b789 could not be found. {{(pid=116863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:23:09.392527 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-5252be80-45e4-480c-a9f8-509ead9830c1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 404 len: 111 microversion: 2.1 time: 0.030635 Jan 24 09:23:09.393081 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 455/898] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:09 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 09:23:09.402264 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-73d76170-17aa-4fc2-be4b-dbbd7cc49cf4 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '.version_select at 0x7f473d2c3310>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:09.545839 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-73d76170-17aa-4fc2-be4b-dbbd7cc49cf4 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2074494851" status: 202 len: 0 microversion: 2.1 time: 0.147846 Jan 24 09:23:09.546457 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 444/899] 10.222.0.113 () {58 vars in 1225 bytes} [Mon Jan 24 09:23:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2074494851 => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 24 09:23:09.736685 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-89763cad-2987-4a0a-94a2-1c3d1f7fd1ee tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:09.737611 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-89763cad-2987-4a0a-94a2-1c3d1f7fd1ee tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:09.744391 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-89763cad-2987-4a0a-94a2-1c3d1f7fd1ee tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:09.744831 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-89763cad-2987-4a0a-94a2-1c3d1f7fd1ee tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:09.745598 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-89763cad-2987-4a0a-94a2-1c3d1f7fd1ee tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:09.746027 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-89763cad-2987-4a0a-94a2-1c3d1f7fd1ee tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:09.829814 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-89763cad-2987-4a0a-94a2-1c3d1f7fd1ee tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action" status: 200 len: 28069 microversion: 2.20 time: 0.096654 Jan 24 09:23:09.830902 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 456/900] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:23:09 2022] POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action => generated 28069 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:23:10.399458 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-9c4cda80-a0f7-45c4-8a45-e8052823a495 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'create', calling method: .version_select at 0x7f473d25bd30>, body: {"keypair": {"name": "tempest-keypair-107360112"}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:10.413797 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.quota [None req-9c4cda80-a0f7-45c4-8a45-e8052823a495 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Getting quotas for project 1dc910091533410a986175bf4570f541. Resources: {'key_pairs'} {{(pid=116864) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 09:23:10.417523 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.quota [None req-9c4cda80-a0f7-45c4-8a45-e8052823a495 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Getting quotas for user 1474c62f3a5d4363ba48daf145765db6 and project 1dc910091533410a986175bf4570f541. Resources: {'key_pairs'} {{(pid=116864) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 09:23:10.763699 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.quota [None req-9c4cda80-a0f7-45c4-8a45-e8052823a495 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Getting quotas for project 1dc910091533410a986175bf4570f541. Resources: {'key_pairs'} {{(pid=116864) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 09:23:10.767627 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.quota [None req-9c4cda80-a0f7-45c4-8a45-e8052823a495 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Getting quotas for user 1474c62f3a5d4363ba48daf145765db6 and project 1dc910091533410a986175bf4570f541. Resources: {'key_pairs'} {{(pid=116864) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 09:23:10.781521 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-9c4cda80-a0f7-45c4-8a45-e8052823a495 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.386446 Jan 24 09:23:10.782155 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 445/901] 10.222.0.113 () {60 vars in 1162 bytes} [Mon Jan 24 09:23:10 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:23:10.844381 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-d630ca7b-03c8-49b7-b7a9-d7dfb681a57e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:10.845395 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-d630ca7b-03c8-49b7-b7a9-d7dfb681a57e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:10.855260 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d630ca7b-03c8-49b7-b7a9-d7dfb681a57e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:10.855716 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d630ca7b-03c8-49b7-b7a9-d7dfb681a57e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:10.856608 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d630ca7b-03c8-49b7-b7a9-d7dfb681a57e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:10.857055 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d630ca7b-03c8-49b7-b7a9-d7dfb681a57e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:10.937047 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-d630ca7b-03c8-49b7-b7a9-d7dfb681a57e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action" status: 200 len: 28196 microversion: 2.20 time: 0.098222 Jan 24 09:23:10.937698 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 457/902] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:23:10 2022] POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action => generated 28196 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:23:11.949436 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-7211a890-52ad-4d9c-89c9-37c9694f55d5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:11.950495 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-7211a890-52ad-4d9c-89c9-37c9694f55d5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:11.957548 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-7211a890-52ad-4d9c-89c9-37c9694f55d5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:11.962568 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-7211a890-52ad-4d9c-89c9-37c9694f55d5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:11.962568 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-7211a890-52ad-4d9c-89c9-37c9694f55d5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:11.962568 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-7211a890-52ad-4d9c-89c9-37c9694f55d5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:12.025533 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-7211a890-52ad-4d9c-89c9-37c9694f55d5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action" status: 200 len: 28196 microversion: 2.20 time: 0.080013 Jan 24 09:23:12.026213 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 446/903] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:23:11 2022] POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action => generated 28196 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:23:13.038525 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-32af8eb0-f8ae-4df3-8957-982c7c378150 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:13.039671 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-32af8eb0-f8ae-4df3-8957-982c7c378150 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:13.047538 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-32af8eb0-f8ae-4df3-8957-982c7c378150 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:13.050201 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-32af8eb0-f8ae-4df3-8957-982c7c378150 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:13.050201 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-32af8eb0-f8ae-4df3-8957-982c7c378150 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:13.050201 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-32af8eb0-f8ae-4df3-8957-982c7c378150 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:13.127747 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-32af8eb0-f8ae-4df3-8957-982c7c378150 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action" status: 200 len: 28486 microversion: 2.20 time: 0.094151 Jan 24 09:23:13.128458 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 458/904] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:23:13 2022] POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action => generated 28486 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 09:23:13.449031 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-715b068e-7acc-481f-90f5-8e29a40af78e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1742419475", "imageRef": "c527e37f-a381-465e-babe-11528029ed9b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cecc965a-bd5f-433d-822a-db760db2c0ab"}], "security_groups": [{"name": "tempest-securitygroup--2064159945"}], "key_name": "tempest-keypair-107360112", "user_data": "}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:13.563442 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.network.neutron [None req-715b068e-7acc-481f-90f5-8e29a40af78e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] validate_networks() for [('cecc965a-bd5f-433d-822a-db760db2c0ab', None, None, None, None, None)] {{(pid=116864) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 09:23:14.040296 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-715b068e-7acc-481f-90f5-8e29a40af78e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Flavor limits 0:0:0 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 09:23:14.040726 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-715b068e-7acc-481f-90f5-8e29a40af78e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Image limits 0:0:0 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 09:23:14.041464 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-715b068e-7acc-481f-90f5-8e29a40af78e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Flavor pref 0:0:0 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 09:23:14.041882 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-715b068e-7acc-481f-90f5-8e29a40af78e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Image pref 0:0:0 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 09:23:14.042336 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-715b068e-7acc-481f-90f5-8e29a40af78e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 09:23:14.051383 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-715b068e-7acc-481f-90f5-8e29a40af78e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:14.051835 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-715b068e-7acc-481f-90f5-8e29a40af78e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:14.053641 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-715b068e-7acc-481f-90f5-8e29a40af78e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:14.054083 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-715b068e-7acc-481f-90f5-8e29a40af78e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:14.070828 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.quota [None req-715b068e-7acc-481f-90f5-8e29a40af78e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Getting quotas for project 1dc910091533410a986175bf4570f541. Resources: {'ram', 'cores', 'instances'} {{(pid=116864) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 09:23:14.074682 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.quota [None req-715b068e-7acc-481f-90f5-8e29a40af78e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Getting quotas for user 1474c62f3a5d4363ba48daf145765db6 and project 1dc910091533410a986175bf4570f541. Resources: {'ram', 'cores', 'instances'} {{(pid=116864) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 09:23:14.086262 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-715b068e-7acc-481f-90f5-8e29a40af78e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Going to run 1 instances... {{(pid=116864) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 09:23:14.088672 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-715b068e-7acc-481f-90f5-8e29a40af78e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c527e37f-a381-465e-babe-11528029ed9b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 09:23:14.139448 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-e7da2020-4725-425c-bd6f-3e269811cf70 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:14.140453 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-e7da2020-4725-425c-bd6f-3e269811cf70 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:14.148179 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e7da2020-4725-425c-bd6f-3e269811cf70 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:14.148637 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e7da2020-4725-425c-bd6f-3e269811cf70 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:14.149425 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e7da2020-4725-425c-bd6f-3e269811cf70 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:14.149865 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e7da2020-4725-425c-bd6f-3e269811cf70 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:14.233851 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-715b068e-7acc-481f-90f5-8e29a40af78e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.789290 Jan 24 09:23:14.239099 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 447/905] 10.222.0.113 () {60 vars in 1151 bytes} [Mon Jan 24 09:23:13 2022] POST /compute/v2.1/servers => generated 404 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 24 09:23:14.239275 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-e7da2020-4725-425c-bd6f-3e269811cf70 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action" status: 200 len: 28654 microversion: 2.20 time: 0.101404 Jan 24 09:23:14.239275 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 459/906] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:23:14 2022] POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action => generated 28654 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 09:23:14.245038 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-0a2b0720-a189-4698-bf4c-02ad7d37d4a9 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:14.245652 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-0a2b0720-a189-4698-bf4c-02ad7d37d4a9 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:14.298369 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-0a2b0720-a189-4698-bf4c-02ad7d37d4a9 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:14.305390 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-0a2b0720-a189-4698-bf4c-02ad7d37d4a9 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6" status: 200 len: 1241 microversion: 2.1 time: 0.064392 Jan 24 09:23:14.305958 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 448/907] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:14 2022] GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6 => generated 1241 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:23:14.693823 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-8f044951-9888-4ce2-b25f-11a685a8553c tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1152414291", "imageRef": "c527e37f-a381-465e-babe-11528029ed9b", "flavorRef": "452"}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:14.898979 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.network.neutron [None req-8f044951-9888-4ce2-b25f-11a685a8553c tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] validate_networks() for None {{(pid=116863) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 09:23:15.170349 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.virt.hardware [None req-8f044951-9888-4ce2-b25f-11a685a8553c tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Flavor limits 0:0:0 {{(pid=116863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 09:23:15.170978 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.virt.hardware [None req-8f044951-9888-4ce2-b25f-11a685a8553c tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Image limits 0:0:0 {{(pid=116863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 09:23:15.171562 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.virt.hardware [None req-8f044951-9888-4ce2-b25f-11a685a8553c tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Flavor pref 0:0:0 {{(pid=116863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 09:23:15.172098 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.virt.hardware [None req-8f044951-9888-4ce2-b25f-11a685a8553c tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Image pref 0:0:0 {{(pid=116863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 09:23:15.172638 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.virt.hardware [None req-8f044951-9888-4ce2-b25f-11a685a8553c tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 09:23:15.182245 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8f044951-9888-4ce2-b25f-11a685a8553c tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:15.182700 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8f044951-9888-4ce2-b25f-11a685a8553c tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:15.183521 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8f044951-9888-4ce2-b25f-11a685a8553c tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:15.183974 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8f044951-9888-4ce2-b25f-11a685a8553c tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:15.200500 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.quota [None req-8f044951-9888-4ce2-b25f-11a685a8553c tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Getting quotas for project 9e9934be44344de7ab0d0f94800506a8. Resources: {'ram', 'cores', 'instances'} {{(pid=116863) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 09:23:15.204394 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.quota [None req-8f044951-9888-4ce2-b25f-11a685a8553c tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Getting quotas for user 7b6759ec2c684364a2a1ecfd5ee2a947 and project 9e9934be44344de7ab0d0f94800506a8. Resources: {'ram', 'cores', 'instances'} {{(pid=116863) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 09:23:15.215431 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-8f044951-9888-4ce2-b25f-11a685a8553c tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Going to run 1 instances... {{(pid=116863) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 09:23:15.217812 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-8f044951-9888-4ce2-b25f-11a685a8553c tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] [instance: e0da7e40-72fc-4851-9b48-79c1a222755b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c527e37f-a381-465e-babe-11528029ed9b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 09:23:15.249838 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-6be26220-5a68-4d7b-b431-2c7caa79853a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:15.251181 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-6be26220-5a68-4d7b-b431-2c7caa79853a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:15.259706 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6be26220-5a68-4d7b-b431-2c7caa79853a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:15.260167 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6be26220-5a68-4d7b-b431-2c7caa79853a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:15.260967 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6be26220-5a68-4d7b-b431-2c7caa79853a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:15.261409 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6be26220-5a68-4d7b-b431-2c7caa79853a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:15.331341 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-6be26220-5a68-4d7b-b431-2c7caa79853a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action" status: 200 len: 28654 microversion: 2.20 time: 0.085750 Jan 24 09:23:15.331991 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 449/908] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:23:15 2022] POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action => generated 28654 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 09:23:15.336978 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-f26ff059-bfe0-4a69-a009-ec7b383fdfc4 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:15.337690 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-f26ff059-bfe0-4a69-a009-ec7b383fdfc4 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:15.344744 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f26ff059-bfe0-4a69-a009-ec7b383fdfc4 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:15.345193 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f26ff059-bfe0-4a69-a009-ec7b383fdfc4 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:15.345981 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f26ff059-bfe0-4a69-a009-ec7b383fdfc4 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:15.346445 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f26ff059-bfe0-4a69-a009-ec7b383fdfc4 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:15.406708 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-f26ff059-bfe0-4a69-a009-ec7b383fdfc4 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:15.417272 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-f26ff059-bfe0-4a69-a009-ec7b383fdfc4 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6" status: 200 len: 1245 microversion: 2.1 time: 0.081928 Jan 24 09:23:15.423613 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 450/909] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:15 2022] GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:23:15.423828 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-8f044951-9888-4ce2-b25f-11a685a8553c tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.728074 Jan 24 09:23:15.423828 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 460/910] 10.222.0.113 () {60 vars in 1151 bytes} [Mon Jan 24 09:23:14 2022] POST /compute/v2.1/servers => generated 382 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 24 09:23:15.428690 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-98d05de0-20d3-4833-ae29-dcc5162dcb81 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:15.429350 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-98d05de0-20d3-4833-ae29-dcc5162dcb81 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] [instance: e0da7e40-72fc-4851-9b48-79c1a222755b] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:15.481592 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-98d05de0-20d3-4833-ae29-dcc5162dcb81 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6759ec2c684364a2a1ecfd5ee2a947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9934be44344de7ab0d0f94800506a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:15.488050 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-98d05de0-20d3-4833-ae29-dcc5162dcb81 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] 10.222.0.113 "GET /compute/v2.1/servers/e0da7e40-72fc-4851-9b48-79c1a222755b" status: 200 len: 1219 microversion: 2.1 time: 0.062888 Jan 24 09:23:15.488680 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 451/911] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:15 2022] GET /compute/v2.1/servers/e0da7e40-72fc-4851-9b48-79c1a222755b => generated 1219 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:23:16.344410 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-55de89b5-70ff-4e75-b5c3-68da521fb25d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:16.345501 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-55de89b5-70ff-4e75-b5c3-68da521fb25d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:16.354779 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-55de89b5-70ff-4e75-b5c3-68da521fb25d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:16.355382 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-55de89b5-70ff-4e75-b5c3-68da521fb25d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:16.356440 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-55de89b5-70ff-4e75-b5c3-68da521fb25d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:16.357069 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-55de89b5-70ff-4e75-b5c3-68da521fb25d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:16.422612 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-55de89b5-70ff-4e75-b5c3-68da521fb25d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action" status: 200 len: 28654 microversion: 2.20 time: 0.082693 Jan 24 09:23:16.423252 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 461/912] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:23:16 2022] POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action => generated 28654 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:23:16.434077 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-b09f9c1c-69b3-4668-8c01-322e3b4b3600 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:16.434774 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-b09f9c1c-69b3-4668-8c01-322e3b4b3600 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:16.441800 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b09f9c1c-69b3-4668-8c01-322e3b4b3600 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:16.442329 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b09f9c1c-69b3-4668-8c01-322e3b4b3600 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:16.443059 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b09f9c1c-69b3-4668-8c01-322e3b4b3600 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:16.443494 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b09f9c1c-69b3-4668-8c01-322e3b4b3600 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:16.505246 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-698583b5-3e83-4356-99bf-a35f29e3c3d8 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:16.506054 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-698583b5-3e83-4356-99bf-a35f29e3c3d8 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] [instance: e0da7e40-72fc-4851-9b48-79c1a222755b] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:16.508358 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-b09f9c1c-69b3-4668-8c01-322e3b4b3600 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:16.514362 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-b09f9c1c-69b3-4668-8c01-322e3b4b3600 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6" status: 200 len: 1293 microversion: 2.1 time: 0.083884 Jan 24 09:23:16.515089 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 452/913] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:16 2022] GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6 => generated 1293 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:23:16.561764 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-698583b5-3e83-4356-99bf-a35f29e3c3d8 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6759ec2c684364a2a1ecfd5ee2a947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9934be44344de7ab0d0f94800506a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:16.568853 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-698583b5-3e83-4356-99bf-a35f29e3c3d8 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] 10.222.0.113 "GET /compute/v2.1/servers/e0da7e40-72fc-4851-9b48-79c1a222755b" status: 200 len: 1219 microversion: 2.1 time: 0.067775 Jan 24 09:23:16.569661 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 462/914] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:16 2022] GET /compute/v2.1/servers/e0da7e40-72fc-4851-9b48-79c1a222755b => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:23:17.435957 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-2bbe379f-34b3-4aae-91cc-5086e4caa96e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:17.437515 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-2bbe379f-34b3-4aae-91cc-5086e4caa96e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:17.445292 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2bbe379f-34b3-4aae-91cc-5086e4caa96e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:17.445951 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2bbe379f-34b3-4aae-91cc-5086e4caa96e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:17.449447 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2bbe379f-34b3-4aae-91cc-5086e4caa96e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:17.449447 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2bbe379f-34b3-4aae-91cc-5086e4caa96e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:17.515594 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-2bbe379f-34b3-4aae-91cc-5086e4caa96e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action" status: 200 len: 28654 microversion: 2.20 time: 0.083197 Jan 24 09:23:17.519729 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 453/915] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:23:17 2022] POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action => generated 28654 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:23:17.533617 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-f721ad87-a04d-4f0b-95f6-562f33c5d458 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:17.537607 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-f721ad87-a04d-4f0b-95f6-562f33c5d458 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:17.541749 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f721ad87-a04d-4f0b-95f6-562f33c5d458 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:17.542351 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f721ad87-a04d-4f0b-95f6-562f33c5d458 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:17.543481 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f721ad87-a04d-4f0b-95f6-562f33c5d458 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:17.543870 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f721ad87-a04d-4f0b-95f6-562f33c5d458 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:17.586748 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-fa20e9f3-5332-4eb9-ad85-d096a3046d6a tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:17.587995 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-fa20e9f3-5332-4eb9-ad85-d096a3046d6a tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] [instance: e0da7e40-72fc-4851-9b48-79c1a222755b] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:17.595131 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fa20e9f3-5332-4eb9-ad85-d096a3046d6a tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:17.595615 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fa20e9f3-5332-4eb9-ad85-d096a3046d6a tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:17.596411 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fa20e9f3-5332-4eb9-ad85-d096a3046d6a tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:17.596850 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fa20e9f3-5332-4eb9-ad85-d096a3046d6a tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:17.661203 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-fa20e9f3-5332-4eb9-ad85-d096a3046d6a tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6759ec2c684364a2a1ecfd5ee2a947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9934be44344de7ab0d0f94800506a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:17.674978 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-fa20e9f3-5332-4eb9-ad85-d096a3046d6a tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] 10.222.0.113 "GET /compute/v2.1/servers/e0da7e40-72fc-4851-9b48-79c1a222755b" status: 200 len: 1271 microversion: 2.1 time: 0.089437 Jan 24 09:23:17.674978 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 454/916] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:17 2022] GET /compute/v2.1/servers/e0da7e40-72fc-4851-9b48-79c1a222755b => generated 1271 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:23:17.770472 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-f721ad87-a04d-4f0b-95f6-562f33c5d458 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:17.778008 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-f721ad87-a04d-4f0b-95f6-562f33c5d458 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6" status: 200 len: 1367 microversion: 2.1 time: 0.248008 Jan 24 09:23:17.778619 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 463/917] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:17 2022] GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6 => generated 1367 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:23:18.528741 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-8e21939b-dc29-4543-9206-291ddece8e68 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:18.529789 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-8e21939b-dc29-4543-9206-291ddece8e68 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:18.540648 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-8e21939b-dc29-4543-9206-291ddece8e68 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:18.544051 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-8e21939b-dc29-4543-9206-291ddece8e68 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:18.544051 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-8e21939b-dc29-4543-9206-291ddece8e68 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:18.544051 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-8e21939b-dc29-4543-9206-291ddece8e68 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:18.631373 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-8e21939b-dc29-4543-9206-291ddece8e68 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action" status: 200 len: 29445 microversion: 2.20 time: 0.107371 Jan 24 09:23:18.632972 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 455/918] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:23:18 2022] POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action => generated 29445 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:23:18.691013 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-21f468f2-4602-436f-bdd5-cc58c625d7f0 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:18.691630 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-21f468f2-4602-436f-bdd5-cc58c625d7f0 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] [instance: e0da7e40-72fc-4851-9b48-79c1a222755b] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:18.699659 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-21f468f2-4602-436f-bdd5-cc58c625d7f0 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:18.700364 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-21f468f2-4602-436f-bdd5-cc58c625d7f0 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:18.701335 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-21f468f2-4602-436f-bdd5-cc58c625d7f0 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:18.701940 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-21f468f2-4602-436f-bdd5-cc58c625d7f0 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:18.784626 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-21f468f2-4602-436f-bdd5-cc58c625d7f0 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6759ec2c684364a2a1ecfd5ee2a947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9934be44344de7ab0d0f94800506a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:18.794192 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-21f468f2-4602-436f-bdd5-cc58c625d7f0 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] 10.222.0.113 "GET /compute/v2.1/servers/e0da7e40-72fc-4851-9b48-79c1a222755b" status: 200 len: 1277 microversion: 2.1 time: 0.107669 Jan 24 09:23:18.801862 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-09dedc67-bd64-4a15-974e-89689457646b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:18.802869 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-09dedc67-bd64-4a15-974e-89689457646b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:18.804164 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 464/919] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:18 2022] GET /compute/v2.1/servers/e0da7e40-72fc-4851-9b48-79c1a222755b => generated 1277 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:23:18.811416 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-09dedc67-bd64-4a15-974e-89689457646b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:18.811890 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-09dedc67-bd64-4a15-974e-89689457646b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:18.812844 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-09dedc67-bd64-4a15-974e-89689457646b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:18.813279 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-09dedc67-bd64-4a15-974e-89689457646b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:18.933789 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [req-7362f244-e6eb-4ad9-82e7-e89cb17277cc req-74cc0459-6a28-4ed7-8f83-a4a87882b555 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3b808fd-b585-4062-a321-9965f704ffe6", "tag": "27389513-03ea-4e61-98b8-afb32fb7a007"}]} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:18.936583 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:23:18.936583 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: warnings.warn(msg) Jan 24 09:23:18.945447 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-7362f244-e6eb-4ad9-82e7-e89cb17277cc req-74cc0459-6a28-4ed7-8f83-a4a87882b555 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:18.946281 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-7362f244-e6eb-4ad9-82e7-e89cb17277cc req-74cc0459-6a28-4ed7-8f83-a4a87882b555 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:18.956145 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-09dedc67-bd64-4a15-974e-89689457646b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:18.960449 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.compute.server_external_events [req-7362f244-e6eb-4ad9-82e7-e89cb17277cc req-74cc0459-6a28-4ed7-8f83-a4a87882b555 service nova] Creating event network-changed:27389513-03ea-4e61-98b8-afb32fb7a007 for instance f3b808fd-b585-4062-a321-9965f704ffe6 on hv-cinder-80403 Jan 24 09:23:18.966565 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-09dedc67-bd64-4a15-974e-89689457646b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6" status: 200 len: 1367 microversion: 2.1 time: 0.174176 Jan 24 09:23:18.968773 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [req-7362f244-e6eb-4ad9-82e7-e89cb17277cc req-74cc0459-6a28-4ed7-8f83-a4a87882b555 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040727 Jan 24 09:23:18.969369 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 465/920] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 09:23:18.971015 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 456/921] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:18 2022] GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:23:19.644817 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-562ffafe-abbf-4460-9e65-f298295e7c14 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:19.645949 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-562ffafe-abbf-4460-9e65-f298295e7c14 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:19.653770 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-562ffafe-abbf-4460-9e65-f298295e7c14 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:19.654441 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-562ffafe-abbf-4460-9e65-f298295e7c14 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:19.655276 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-562ffafe-abbf-4460-9e65-f298295e7c14 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:19.655709 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-562ffafe-abbf-4460-9e65-f298295e7c14 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:19.753510 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-562ffafe-abbf-4460-9e65-f298295e7c14 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action" status: 200 len: 31125 microversion: 2.20 time: 0.113101 Jan 24 09:23:19.758214 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 457/922] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:23:19 2022] POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action => generated 31125 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:23:19.803704 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-ef1d4ac2-4811-4d9c-9008-5f17974019c3 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:19.804314 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-ef1d4ac2-4811-4d9c-9008-5f17974019c3 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f31eba5c-d268-48b8-8d66-c1da93154cc4] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:19.813912 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ef1d4ac2-4811-4d9c-9008-5f17974019c3 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:19.814420 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ef1d4ac2-4811-4d9c-9008-5f17974019c3 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:19.815266 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ef1d4ac2-4811-4d9c-9008-5f17974019c3 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:19.815420 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-baedef95-fd4c-4d29-91e8-963cab8a3bb2 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:19.816118 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-baedef95-fd4c-4d29-91e8-963cab8a3bb2 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] [instance: e0da7e40-72fc-4851-9b48-79c1a222755b] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:19.816403 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ef1d4ac2-4811-4d9c-9008-5f17974019c3 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:19.827060 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-baedef95-fd4c-4d29-91e8-963cab8a3bb2 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:19.827701 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-baedef95-fd4c-4d29-91e8-963cab8a3bb2 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:19.829323 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-baedef95-fd4c-4d29-91e8-963cab8a3bb2 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:19.829992 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-baedef95-fd4c-4d29-91e8-963cab8a3bb2 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:19.851129 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-ef1d4ac2-4811-4d9c-9008-5f17974019c3 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f31eba5c-d268-48b8-8d66-c1da93154cc4] Going to try to terminate instance {{(pid=116863) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 09:23:20.097656 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-baedef95-fd4c-4d29-91e8-963cab8a3bb2 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6759ec2c684364a2a1ecfd5ee2a947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9934be44344de7ab0d0f94800506a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:20.108306 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-baedef95-fd4c-4d29-91e8-963cab8a3bb2 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] 10.222.0.113 "GET /compute/v2.1/servers/e0da7e40-72fc-4851-9b48-79c1a222755b" status: 200 len: 1319 microversion: 2.1 time: 0.298415 Jan 24 09:23:20.109144 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 458/923] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:19 2022] GET /compute/v2.1/servers/e0da7e40-72fc-4851-9b48-79c1a222755b => generated 1319 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:23:20.123215 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-a66a86cc-d095-4c4c-a2fa-550d220dbfb5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:20.123939 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-a66a86cc-d095-4c4c-a2fa-550d220dbfb5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:20.136590 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a66a86cc-d095-4c4c-a2fa-550d220dbfb5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:20.137056 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a66a86cc-d095-4c4c-a2fa-550d220dbfb5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:20.137860 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a66a86cc-d095-4c4c-a2fa-550d220dbfb5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:20.140841 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a66a86cc-d095-4c4c-a2fa-550d220dbfb5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:20.264451 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-ef1d4ac2-4811-4d9c-9008-5f17974019c3 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "DELETE /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4" status: 204 len: 0 microversion: 2.1 time: 0.466716 Jan 24 09:23:20.268681 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 466/924] 10.222.0.113 () {58 vars in 1243 bytes} [Mon Jan 24 09:23:19 2022] DELETE /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 24 09:23:20.274291 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-87f02029-e987-4d8f-a8ae-21306bca9e11 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:20.275397 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-87f02029-e987-4d8f-a8ae-21306bca9e11 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f31eba5c-d268-48b8-8d66-c1da93154cc4] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:20.283084 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-87f02029-e987-4d8f-a8ae-21306bca9e11 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:20.283530 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-87f02029-e987-4d8f-a8ae-21306bca9e11 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:20.284305 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-87f02029-e987-4d8f-a8ae-21306bca9e11 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:20.284910 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-87f02029-e987-4d8f-a8ae-21306bca9e11 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:20.406338 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-a66a86cc-d095-4c4c-a2fa-550d220dbfb5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:20.413941 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-a66a86cc-d095-4c4c-a2fa-550d220dbfb5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6" status: 200 len: 1367 microversion: 2.1 time: 0.298166 Jan 24 09:23:20.414559 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 459/925] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:20 2022] GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6 => generated 1367 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:23:20.484939 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-87f02029-e987-4d8f-a8ae-21306bca9e11 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:20.493171 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-87f02029-e987-4d8f-a8ae-21306bca9e11 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4" status: 200 len: 1579 microversion: 2.1 time: 0.222683 Jan 24 09:23:20.494404 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 467/926] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:20 2022] GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4 => generated 1579 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:23:20.765834 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-e1b42f9d-b29c-4238-96e0-67390952be9c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:20.770673 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-e1b42f9d-b29c-4238-96e0-67390952be9c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:20.773206 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e1b42f9d-b29c-4238-96e0-67390952be9c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:20.773658 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e1b42f9d-b29c-4238-96e0-67390952be9c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:20.774487 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e1b42f9d-b29c-4238-96e0-67390952be9c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:20.776111 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e1b42f9d-b29c-4238-96e0-67390952be9c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:20.874424 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-e1b42f9d-b29c-4238-96e0-67390952be9c tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action" status: 200 len: 32137 microversion: 2.20 time: 0.112117 Jan 24 09:23:20.875467 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 460/927] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:23:20 2022] POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action => generated 32137 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 09:23:20.986132 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [req-56ee84b1-93f5-42b8-be74-fa389555c111 req-5a8033a1-da49-4ceb-8344-dc793d6395f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0da7e40-72fc-4851-9b48-79c1a222755b", "tag": "2c19c235-0e2f-4db9-aa73-c1e9f3c69ff3"}]} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:20.987689 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:23:20.987689 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: warnings.warn(msg) Jan 24 09:23:20.995852 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-56ee84b1-93f5-42b8-be74-fa389555c111 req-5a8033a1-da49-4ceb-8344-dc793d6395f6 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:20.996308 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-56ee84b1-93f5-42b8-be74-fa389555c111 req-5a8033a1-da49-4ceb-8344-dc793d6395f6 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:21.007784 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.compute.server_external_events [req-56ee84b1-93f5-42b8-be74-fa389555c111 req-5a8033a1-da49-4ceb-8344-dc793d6395f6 service nova] Creating event network-changed:2c19c235-0e2f-4db9-aa73-c1e9f3c69ff3 for instance e0da7e40-72fc-4851-9b48-79c1a222755b on hv-cinder-80403 Jan 24 09:23:21.014059 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [req-56ee84b1-93f5-42b8-be74-fa389555c111 req-5a8033a1-da49-4ceb-8344-dc793d6395f6 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031552 Jan 24 09:23:21.014697 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 468/928] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:23:21.125526 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-c4304c05-26f3-48b1-9606-6900e83fd4fb tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:21.126255 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-c4304c05-26f3-48b1-9606-6900e83fd4fb tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] [instance: e0da7e40-72fc-4851-9b48-79c1a222755b] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:21.133484 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c4304c05-26f3-48b1-9606-6900e83fd4fb tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:21.134433 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c4304c05-26f3-48b1-9606-6900e83fd4fb tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:21.135448 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c4304c05-26f3-48b1-9606-6900e83fd4fb tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:21.135897 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c4304c05-26f3-48b1-9606-6900e83fd4fb tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:21.352272 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-c4304c05-26f3-48b1-9606-6900e83fd4fb tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6759ec2c684364a2a1ecfd5ee2a947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9934be44344de7ab0d0f94800506a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:21.360318 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-c4304c05-26f3-48b1-9606-6900e83fd4fb tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] 10.222.0.113 "GET /compute/v2.1/servers/e0da7e40-72fc-4851-9b48-79c1a222755b" status: 200 len: 1319 microversion: 2.1 time: 0.238845 Jan 24 09:23:21.360914 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 461/929] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:21 2022] GET /compute/v2.1/servers/e0da7e40-72fc-4851-9b48-79c1a222755b => generated 1319 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:23:21.432846 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-5dc09b66-5475-4e56-b3bd-ee1e6d86fea5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:21.433638 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-5dc09b66-5475-4e56-b3bd-ee1e6d86fea5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:21.440164 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5dc09b66-5475-4e56-b3bd-ee1e6d86fea5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:21.440617 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5dc09b66-5475-4e56-b3bd-ee1e6d86fea5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:21.441424 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5dc09b66-5475-4e56-b3bd-ee1e6d86fea5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:21.441866 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5dc09b66-5475-4e56-b3bd-ee1e6d86fea5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:21.516572 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-6dea32b6-2204-4f3a-a670-95810472971c tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:21.517177 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-6dea32b6-2204-4f3a-a670-95810472971c tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f31eba5c-d268-48b8-8d66-c1da93154cc4] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:21.523433 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6dea32b6-2204-4f3a-a670-95810472971c tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:21.523904 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6dea32b6-2204-4f3a-a670-95810472971c tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:21.525479 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6dea32b6-2204-4f3a-a670-95810472971c tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:21.525955 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6dea32b6-2204-4f3a-a670-95810472971c tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:21.583452 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-5dc09b66-5475-4e56-b3bd-ee1e6d86fea5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:21.591636 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-5dc09b66-5475-4e56-b3bd-ee1e6d86fea5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6" status: 200 len: 1367 microversion: 2.1 time: 0.163086 Jan 24 09:23:21.592564 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 469/930] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:21 2022] GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:23:21.725205 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-6dea32b6-2204-4f3a-a670-95810472971c tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:21.732772 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-6dea32b6-2204-4f3a-a670-95810472971c tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4" status: 200 len: 1579 microversion: 2.1 time: 0.219872 Jan 24 09:23:21.733357 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 462/931] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:21 2022] GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4 => generated 1579 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:23:21.886076 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-03c78985-0f93-48a3-bafe-121f0027ccae tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:21.887022 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-03c78985-0f93-48a3-bafe-121f0027ccae tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:21.893072 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-03c78985-0f93-48a3-bafe-121f0027ccae tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:21.893519 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-03c78985-0f93-48a3-bafe-121f0027ccae tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:21.894336 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-03c78985-0f93-48a3-bafe-121f0027ccae tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:21.894773 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-03c78985-0f93-48a3-bafe-121f0027ccae tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:22.001460 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-03c78985-0f93-48a3-bafe-121f0027ccae tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action" status: 200 len: 32822 microversion: 2.20 time: 0.119325 Jan 24 09:23:22.002808 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 470/932] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:23:21 2022] POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action => generated 32822 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:23:22.377129 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-8006cfd4-768c-46aa-8c00-a968ad18acd4 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:22.377743 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-8006cfd4-768c-46aa-8c00-a968ad18acd4 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] [instance: e0da7e40-72fc-4851-9b48-79c1a222755b] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:22.384845 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-8006cfd4-768c-46aa-8c00-a968ad18acd4 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:22.385291 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-8006cfd4-768c-46aa-8c00-a968ad18acd4 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:22.386073 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-8006cfd4-768c-46aa-8c00-a968ad18acd4 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:22.386521 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-8006cfd4-768c-46aa-8c00-a968ad18acd4 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:22.520296 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-8006cfd4-768c-46aa-8c00-a968ad18acd4 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6759ec2c684364a2a1ecfd5ee2a947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9934be44344de7ab0d0f94800506a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:22.529181 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-8006cfd4-768c-46aa-8c00-a968ad18acd4 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] 10.222.0.113 "GET /compute/v2.1/servers/e0da7e40-72fc-4851-9b48-79c1a222755b" status: 200 len: 1319 microversion: 2.1 time: 0.156265 Jan 24 09:23:22.529767 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 463/933] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:22 2022] GET /compute/v2.1/servers/e0da7e40-72fc-4851-9b48-79c1a222755b => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:23:22.609808 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-e39ba425-6ec0-4183-b805-caa399126878 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:22.610547 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-e39ba425-6ec0-4183-b805-caa399126878 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:22.617353 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e39ba425-6ec0-4183-b805-caa399126878 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:22.617841 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e39ba425-6ec0-4183-b805-caa399126878 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:22.619286 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e39ba425-6ec0-4183-b805-caa399126878 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:22.619763 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e39ba425-6ec0-4183-b805-caa399126878 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:22.751159 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-aff056b4-af28-464f-921f-41618633836d tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:22.751815 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-aff056b4-af28-464f-921f-41618633836d tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f31eba5c-d268-48b8-8d66-c1da93154cc4] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:22.757755 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-aff056b4-af28-464f-921f-41618633836d tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:22.758244 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-aff056b4-af28-464f-921f-41618633836d tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:22.759130 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-aff056b4-af28-464f-921f-41618633836d tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:22.759564 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-aff056b4-af28-464f-921f-41618633836d tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:22.759752 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-e39ba425-6ec0-4183-b805-caa399126878 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:22.770570 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-e39ba425-6ec0-4183-b805-caa399126878 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6" status: 200 len: 1367 microversion: 2.1 time: 0.164807 Jan 24 09:23:22.771489 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 471/934] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:22 2022] GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:23:23.013876 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-b6bac28f-ad40-43cb-be1f-5049aee5697f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:23.014770 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-b6bac28f-ad40-43cb-be1f-5049aee5697f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:23.021034 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b6bac28f-ad40-43cb-be1f-5049aee5697f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:23.021485 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b6bac28f-ad40-43cb-be1f-5049aee5697f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:23.022316 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b6bac28f-ad40-43cb-be1f-5049aee5697f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:23.022758 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b6bac28f-ad40-43cb-be1f-5049aee5697f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:23.063862 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-aff056b4-af28-464f-921f-41618633836d tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:23.071067 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-aff056b4-af28-464f-921f-41618633836d tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4" status: 200 len: 1579 microversion: 2.1 time: 0.323721 Jan 24 09:23:23.072505 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 464/935] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:22 2022] GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4 => generated 1579 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:23:23.108142 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-b6bac28f-ad40-43cb-be1f-5049aee5697f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action" status: 200 len: 33304 microversion: 2.20 time: 0.098808 Jan 24 09:23:23.112272 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 472/936] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:23:23 2022] POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action => generated 33304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 09:23:23.545804 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-a5379b2b-3646-4ae7-8807-3017f7de7345 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:23.546461 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-a5379b2b-3646-4ae7-8807-3017f7de7345 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] [instance: e0da7e40-72fc-4851-9b48-79c1a222755b] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:23.552238 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a5379b2b-3646-4ae7-8807-3017f7de7345 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:23.559309 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a5379b2b-3646-4ae7-8807-3017f7de7345 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:23.559309 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a5379b2b-3646-4ae7-8807-3017f7de7345 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:23.559309 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a5379b2b-3646-4ae7-8807-3017f7de7345 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:23.788190 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-f0042b26-e329-4762-99ee-3af078c02136 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:23.788905 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-f0042b26-e329-4762-99ee-3af078c02136 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:23.797043 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f0042b26-e329-4762-99ee-3af078c02136 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:23.798316 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f0042b26-e329-4762-99ee-3af078c02136 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:23.799234 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f0042b26-e329-4762-99ee-3af078c02136 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:23.799749 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f0042b26-e329-4762-99ee-3af078c02136 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:23.820888 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-a5379b2b-3646-4ae7-8807-3017f7de7345 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6759ec2c684364a2a1ecfd5ee2a947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9934be44344de7ab0d0f94800506a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:23.829550 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-a5379b2b-3646-4ae7-8807-3017f7de7345 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] 10.222.0.113 "GET /compute/v2.1/servers/e0da7e40-72fc-4851-9b48-79c1a222755b" status: 200 len: 1319 microversion: 2.1 time: 0.287536 Jan 24 09:23:23.830604 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 465/937] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:23 2022] GET /compute/v2.1/servers/e0da7e40-72fc-4851-9b48-79c1a222755b => generated 1319 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:23:23.835518 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [req-dd5fad06-cf6c-486e-bd27-fc06485d5a5b req-190ecb1b-1bc9-44a7-be58-24cb6522459b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f31eba5c-d268-48b8-8d66-c1da93154cc4", "name": "network-vif-deleted", "tag": "6ecce77c-24a9-465d-84b4-0e5e56ded4dd"}]} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:23.837931 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:23:23.837931 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: warnings.warn(msg) Jan 24 09:23:23.849782 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-dd5fad06-cf6c-486e-bd27-fc06485d5a5b req-190ecb1b-1bc9-44a7-be58-24cb6522459b service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:23.850429 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-dd5fad06-cf6c-486e-bd27-fc06485d5a5b req-190ecb1b-1bc9-44a7-be58-24cb6522459b service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:23.864713 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.compute.server_external_events [req-dd5fad06-cf6c-486e-bd27-fc06485d5a5b req-190ecb1b-1bc9-44a7-be58-24cb6522459b service nova] Creating event network-vif-deleted:6ecce77c-24a9-465d-84b4-0e5e56ded4dd for instance f31eba5c-d268-48b8-8d66-c1da93154cc4 on hv-cinder-80403 Jan 24 09:23:23.870696 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [req-dd5fad06-cf6c-486e-bd27-fc06485d5a5b req-190ecb1b-1bc9-44a7-be58-24cb6522459b service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038693 Jan 24 09:23:23.871554 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 466/938] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:23:23.977873 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-f0042b26-e329-4762-99ee-3af078c02136 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:23.985779 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-f0042b26-e329-4762-99ee-3af078c02136 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6" status: 200 len: 1367 microversion: 2.1 time: 0.201593 Jan 24 09:23:23.986648 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 473/939] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:23 2022] GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6 => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:23:24.090219 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-44b3c785-a1fc-46e1-a111-52a5a49cf812 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:24.090927 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-44b3c785-a1fc-46e1-a111-52a5a49cf812 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f31eba5c-d268-48b8-8d66-c1da93154cc4] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:24.096849 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-44b3c785-a1fc-46e1-a111-52a5a49cf812 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:24.097290 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-44b3c785-a1fc-46e1-a111-52a5a49cf812 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:24.098058 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-44b3c785-a1fc-46e1-a111-52a5a49cf812 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:24.098529 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-44b3c785-a1fc-46e1-a111-52a5a49cf812 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:24.119376 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-ba595ee4-fba6-403d-9dc0-0bbdd8b9ef98 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:24.120363 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-ba595ee4-fba6-403d-9dc0-0bbdd8b9ef98 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:24.126400 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ba595ee4-fba6-403d-9dc0-0bbdd8b9ef98 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:24.126957 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ba595ee4-fba6-403d-9dc0-0bbdd8b9ef98 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:24.128031 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ba595ee4-fba6-403d-9dc0-0bbdd8b9ef98 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:24.128494 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ba595ee4-fba6-403d-9dc0-0bbdd8b9ef98 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:24.162776 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-44b3c785-a1fc-46e1-a111-52a5a49cf812 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:24.171247 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-44b3c785-a1fc-46e1-a111-52a5a49cf812 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4" status: 200 len: 1228 microversion: 2.1 time: 0.086193 Jan 24 09:23:24.171939 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 467/940] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:24 2022] GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4 => generated 1228 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:23:24.215828 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-ba595ee4-fba6-403d-9dc0-0bbdd8b9ef98 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action" status: 200 len: 34190 microversion: 2.20 time: 0.100283 Jan 24 09:23:24.216372 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 474/941] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:23:24 2022] POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action => generated 34190 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 09:23:24.856651 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-04c318eb-f248-489b-bb88-0e0286bb61f2 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:24.856651 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-04c318eb-f248-489b-bb88-0e0286bb61f2 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] [instance: e0da7e40-72fc-4851-9b48-79c1a222755b] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:24.857190 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [req-915f30e2-abdf-40bd-b0a7-3a0469b84d2b req-2dcdceed-4e0d-4275-be97-cd0e3353322a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3b808fd-b585-4062-a321-9965f704ffe6", "name": "network-vif-plugged", "status": "completed", "tag": "27389513-03ea-4e61-98b8-afb32fb7a007"}]} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:24.857190 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:23:24.857190 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: warnings.warn(msg) Jan 24 09:23:24.861953 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-915f30e2-abdf-40bd-b0a7-3a0469b84d2b req-2dcdceed-4e0d-4275-be97-cd0e3353322a service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:24.863973 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-04c318eb-f248-489b-bb88-0e0286bb61f2 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:24.864501 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-04c318eb-f248-489b-bb88-0e0286bb61f2 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:24.865412 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-04c318eb-f248-489b-bb88-0e0286bb61f2 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:24.865920 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-04c318eb-f248-489b-bb88-0e0286bb61f2 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:24.867327 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-915f30e2-abdf-40bd-b0a7-3a0469b84d2b req-2dcdceed-4e0d-4275-be97-cd0e3353322a service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:24.887696 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.compute.server_external_events [req-915f30e2-abdf-40bd-b0a7-3a0469b84d2b req-2dcdceed-4e0d-4275-be97-cd0e3353322a service nova] Creating event network-vif-plugged:27389513-03ea-4e61-98b8-afb32fb7a007 for instance f3b808fd-b585-4062-a321-9965f704ffe6 on hv-cinder-80403 Jan 24 09:23:24.892089 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [req-915f30e2-abdf-40bd-b0a7-3a0469b84d2b req-2dcdceed-4e0d-4275-be97-cd0e3353322a service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163100 Jan 24 09:23:24.893321 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 468/942] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:23:25.005375 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-faa54474-8dd9-4961-8cde-71a8ea310362 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:25.006082 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-faa54474-8dd9-4961-8cde-71a8ea310362 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:25.012905 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-faa54474-8dd9-4961-8cde-71a8ea310362 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:25.013356 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-faa54474-8dd9-4961-8cde-71a8ea310362 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:25.014206 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-faa54474-8dd9-4961-8cde-71a8ea310362 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:25.014687 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-faa54474-8dd9-4961-8cde-71a8ea310362 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:25.032210 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-04c318eb-f248-489b-bb88-0e0286bb61f2 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6759ec2c684364a2a1ecfd5ee2a947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9934be44344de7ab0d0f94800506a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:25.040740 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-04c318eb-f248-489b-bb88-0e0286bb61f2 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] 10.222.0.113 "GET /compute/v2.1/servers/e0da7e40-72fc-4851-9b48-79c1a222755b" status: 200 len: 1319 microversion: 2.1 time: 0.196434 Jan 24 09:23:25.041930 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 475/943] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:24 2022] GET /compute/v2.1/servers/e0da7e40-72fc-4851-9b48-79c1a222755b => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:23:25.169245 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-faa54474-8dd9-4961-8cde-71a8ea310362 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:25.177079 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-faa54474-8dd9-4961-8cde-71a8ea310362 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6" status: 200 len: 1367 microversion: 2.1 time: 0.175677 Jan 24 09:23:25.178009 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 469/944] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:24 2022] GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:23:25.188248 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-bd798dc3-c8df-4b76-983d-4ba3b998db44 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:25.189015 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-bd798dc3-c8df-4b76-983d-4ba3b998db44 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f31eba5c-d268-48b8-8d66-c1da93154cc4] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:25.195440 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bd798dc3-c8df-4b76-983d-4ba3b998db44 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:25.196014 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bd798dc3-c8df-4b76-983d-4ba3b998db44 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:25.197917 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bd798dc3-c8df-4b76-983d-4ba3b998db44 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:25.198628 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bd798dc3-c8df-4b76-983d-4ba3b998db44 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:25.232948 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-3bcbd971-8e7d-4625-ad33-c61aa76cdca6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:25.233347 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bd798dc3-c8df-4b76-983d-4ba3b998db44 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:25.233804 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bd798dc3-c8df-4b76-983d-4ba3b998db44 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:25.234138 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-3bcbd971-8e7d-4625-ad33-c61aa76cdca6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:25.234361 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.objects.instance [None req-bd798dc3-c8df-4b76-983d-4ba3b998db44 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lazy-loading 'fault' on Instance uuid f31eba5c-d268-48b8-8d66-c1da93154cc4 {{(pid=116863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 09:23:25.246573 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3bcbd971-8e7d-4625-ad33-c61aa76cdca6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:25.247040 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3bcbd971-8e7d-4625-ad33-c61aa76cdca6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:25.247837 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3bcbd971-8e7d-4625-ad33-c61aa76cdca6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:25.248274 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3bcbd971-8e7d-4625-ad33-c61aa76cdca6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:25.290558 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-bd798dc3-c8df-4b76-983d-4ba3b998db44 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:25.296645 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-bd798dc3-c8df-4b76-983d-4ba3b998db44 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4" status: 200 len: 1233 microversion: 2.1 time: 0.112199 Jan 24 09:23:25.297310 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 476/945] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:25 2022] GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4 => generated 1233 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:23:25.346819 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-3bcbd971-8e7d-4625-ad33-c61aa76cdca6 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action" status: 200 len: 35427 microversion: 2.20 time: 0.117072 Jan 24 09:23:25.348037 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 470/946] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:23:25 2022] POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action => generated 35427 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 09:23:26.057909 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-a838f5eb-e045-4eee-bc37-2378dedd2215 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:26.058572 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-a838f5eb-e045-4eee-bc37-2378dedd2215 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] [instance: e0da7e40-72fc-4851-9b48-79c1a222755b] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:26.065201 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a838f5eb-e045-4eee-bc37-2378dedd2215 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:26.065701 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a838f5eb-e045-4eee-bc37-2378dedd2215 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:26.066507 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a838f5eb-e045-4eee-bc37-2378dedd2215 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:26.066940 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a838f5eb-e045-4eee-bc37-2378dedd2215 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:26.194532 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-99ff5941-e541-408d-836f-7a2de8de67a5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:26.195880 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-99ff5941-e541-408d-836f-7a2de8de67a5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:26.200924 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-a838f5eb-e045-4eee-bc37-2378dedd2215 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6759ec2c684364a2a1ecfd5ee2a947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9934be44344de7ab0d0f94800506a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:26.203909 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-99ff5941-e541-408d-836f-7a2de8de67a5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:26.204388 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-99ff5941-e541-408d-836f-7a2de8de67a5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:26.205307 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-99ff5941-e541-408d-836f-7a2de8de67a5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:26.205665 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-99ff5941-e541-408d-836f-7a2de8de67a5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:26.208747 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-a838f5eb-e045-4eee-bc37-2378dedd2215 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] 10.222.0.113 "GET /compute/v2.1/servers/e0da7e40-72fc-4851-9b48-79c1a222755b" status: 200 len: 1319 microversion: 2.1 time: 0.155035 Jan 24 09:23:26.209578 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 477/947] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:26 2022] GET /compute/v2.1/servers/e0da7e40-72fc-4851-9b48-79c1a222755b => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:23:26.314737 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-049363c6-579a-419e-9078-352eb4d3bf21 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:26.315685 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-049363c6-579a-419e-9078-352eb4d3bf21 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f31eba5c-d268-48b8-8d66-c1da93154cc4] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:26.322556 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-049363c6-579a-419e-9078-352eb4d3bf21 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:26.323139 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-049363c6-579a-419e-9078-352eb4d3bf21 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:26.324046 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-049363c6-579a-419e-9078-352eb4d3bf21 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:26.324577 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-049363c6-579a-419e-9078-352eb4d3bf21 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:26.338804 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.wsgi [None req-049363c6-579a-419e-9078-352eb4d3bf21 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] HTTP exception thrown: Instance f31eba5c-d268-48b8-8d66-c1da93154cc4 could not be found. Jan 24 09:23:26.339543 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-049363c6-579a-419e-9078-352eb4d3bf21 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Returning 404 to user: Instance f31eba5c-d268-48b8-8d66-c1da93154cc4 could not be found. {{(pid=116863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:23:26.340745 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-049363c6-579a-419e-9078-352eb4d3bf21 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4" status: 404 len: 111 microversion: 2.1 time: 0.029520 Jan 24 09:23:26.341143 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 478/948] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:26 2022] GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 24 09:23:26.351997 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-99ff5941-e541-408d-836f-7a2de8de67a5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:26.358687 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-c6ae6c0c-07e8-466e-9ab0-8644b1eaafc1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:26.360563 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-99ff5941-e541-408d-836f-7a2de8de67a5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6" status: 200 len: 1367 microversion: 2.1 time: 0.170172 Jan 24 09:23:26.360715 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-c6ae6c0c-07e8-466e-9ab0-8644b1eaafc1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:26.361438 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 471/949] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:26 2022] GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:23:26.367186 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c6ae6c0c-07e8-466e-9ab0-8644b1eaafc1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:26.367724 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c6ae6c0c-07e8-466e-9ab0-8644b1eaafc1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:26.368626 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c6ae6c0c-07e8-466e-9ab0-8644b1eaafc1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:26.369065 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c6ae6c0c-07e8-466e-9ab0-8644b1eaafc1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:26.452226 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-037921ba-931b-4a00-902a-a67210933923 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1285977036", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-760537949", "security_groups": [{"name": "tempest-secgroup-smoke-1899158498"}], "block_device_mapping_v2": [{"uuid": "a55500f8-0737-4565-bea5-3ba78687a8ea", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "bb18b00a-6e74-4475-8741-4c8ca85a032a"}]}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:26.468235 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-c6ae6c0c-07e8-466e-9ab0-8644b1eaafc1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action" status: 200 len: 36512 microversion: 2.20 time: 0.112992 Jan 24 09:23:26.470656 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 479/950] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:23:26 2022] POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action => generated 36512 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:23:26.573020 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.network.neutron [None req-037921ba-931b-4a00-902a-a67210933923 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] validate_networks() for [('bb18b00a-6e74-4475-8741-4c8ca85a032a', None, None, None, None, None)] {{(pid=116864) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 09:23:26.922665 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [req-88702101-75d7-4fb3-88b0-04ddf24ff270 req-7bc8711d-730e-44bc-a7ad-b433bf2fbdb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0da7e40-72fc-4851-9b48-79c1a222755b", "name": "network-vif-plugged", "status": "completed", "tag": "2c19c235-0e2f-4db9-aa73-c1e9f3c69ff3"}]} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:26.924578 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:23:26.924578 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: warnings.warn(msg) Jan 24 09:23:26.932754 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-88702101-75d7-4fb3-88b0-04ddf24ff270 req-7bc8711d-730e-44bc-a7ad-b433bf2fbdb6 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:26.933436 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-88702101-75d7-4fb3-88b0-04ddf24ff270 req-7bc8711d-730e-44bc-a7ad-b433bf2fbdb6 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:26.944828 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.compute.server_external_events [req-88702101-75d7-4fb3-88b0-04ddf24ff270 req-7bc8711d-730e-44bc-a7ad-b433bf2fbdb6 service nova] Creating event network-vif-plugged:2c19c235-0e2f-4db9-aa73-c1e9f3c69ff3 for instance e0da7e40-72fc-4851-9b48-79c1a222755b on hv-cinder-80403 Jan 24 09:23:26.949835 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [req-88702101-75d7-4fb3-88b0-04ddf24ff270 req-7bc8711d-730e-44bc-a7ad-b433bf2fbdb6 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031216 Jan 24 09:23:26.951071 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 480/951] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 09:23:26.952555 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-037921ba-931b-4a00-902a-a67210933923 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Flavor limits 0:0:0 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 09:23:26.952981 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-037921ba-931b-4a00-902a-a67210933923 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Image limits 0:0:0 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 09:23:26.953603 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-037921ba-931b-4a00-902a-a67210933923 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Flavor pref 0:0:0 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 09:23:26.953902 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-037921ba-931b-4a00-902a-a67210933923 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Image pref 0:0:0 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 09:23:26.954355 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-037921ba-931b-4a00-902a-a67210933923 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 09:23:26.964357 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-037921ba-931b-4a00-902a-a67210933923 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:26.964881 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-037921ba-931b-4a00-902a-a67210933923 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:26.965950 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-037921ba-931b-4a00-902a-a67210933923 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:26.966415 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-037921ba-931b-4a00-902a-a67210933923 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:26.984711 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.quota [None req-037921ba-931b-4a00-902a-a67210933923 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Getting quotas for project bedaa9b436ab45108aa33633b17e58d0. Resources: {'ram', 'cores', 'instances'} {{(pid=116864) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 09:23:26.989650 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.quota [None req-037921ba-931b-4a00-902a-a67210933923 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Getting quotas for user 91399ccc8ba64dc7becff56785e9b904 and project bedaa9b436ab45108aa33633b17e58d0. Resources: {'ram', 'cores', 'instances'} {{(pid=116864) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 09:23:27.046413 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-037921ba-931b-4a00-902a-a67210933923 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Going to run 1 instances... {{(pid=116864) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 09:23:27.048535 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-037921ba-931b-4a00-902a-a67210933923 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f32748bf-320b-4cb5-9616-7c1d7260e260] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a55500f8-0737-4565-bea5-3ba78687a8ea',volume_size=None,volume_type=None)] {{(pid=116864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 09:23:27.227508 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-0d16a435-a5f9-4e32-bfbd-66af6b8e4bf1 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:27.228449 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-0d16a435-a5f9-4e32-bfbd-66af6b8e4bf1 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] [instance: e0da7e40-72fc-4851-9b48-79c1a222755b] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:27.235142 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0d16a435-a5f9-4e32-bfbd-66af6b8e4bf1 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:27.235595 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0d16a435-a5f9-4e32-bfbd-66af6b8e4bf1 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:27.236388 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0d16a435-a5f9-4e32-bfbd-66af6b8e4bf1 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:27.236828 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0d16a435-a5f9-4e32-bfbd-66af6b8e4bf1 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:27.375705 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-0d16a435-a5f9-4e32-bfbd-66af6b8e4bf1 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6759ec2c684364a2a1ecfd5ee2a947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9934be44344de7ab0d0f94800506a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:27.383096 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-0d16a435-a5f9-4e32-bfbd-66af6b8e4bf1 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] 10.222.0.113 "GET /compute/v2.1/servers/e0da7e40-72fc-4851-9b48-79c1a222755b" status: 200 len: 1319 microversion: 2.1 time: 0.160346 Jan 24 09:23:27.384214 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 481/952] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:27 2022] GET /compute/v2.1/servers/e0da7e40-72fc-4851-9b48-79c1a222755b => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:23:27.388788 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-28dc203f-0ed6-4645-b41b-4e052f38dcdc tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:27.389637 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-28dc203f-0ed6-4645-b41b-4e052f38dcdc tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:27.395355 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-28dc203f-0ed6-4645-b41b-4e052f38dcdc tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:27.395806 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-28dc203f-0ed6-4645-b41b-4e052f38dcdc tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:27.396591 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-28dc203f-0ed6-4645-b41b-4e052f38dcdc tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:27.397027 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-28dc203f-0ed6-4645-b41b-4e052f38dcdc tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:27.514648 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-037921ba-931b-4a00-902a-a67210933923 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.068313 Jan 24 09:23:27.515893 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 472/953] 10.222.0.113 () {60 vars in 1151 bytes} [Mon Jan 24 09:23:26 2022] POST /compute/v2.1/servers => generated 408 bytes in 1070 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jan 24 09:23:27.520860 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-a27b7713-6b4a-48ca-8a9f-9d54e3eab71e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:27.521866 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-a27b7713-6b4a-48ca-8a9f-9d54e3eab71e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:27.529160 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a27b7713-6b4a-48ca-8a9f-9d54e3eab71e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:27.529603 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a27b7713-6b4a-48ca-8a9f-9d54e3eab71e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:27.530414 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a27b7713-6b4a-48ca-8a9f-9d54e3eab71e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:27.530844 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a27b7713-6b4a-48ca-8a9f-9d54e3eab71e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:27.544495 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-28dc203f-0ed6-4645-b41b-4e052f38dcdc tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:27.554225 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-28dc203f-0ed6-4645-b41b-4e052f38dcdc tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6" status: 200 len: 1553 microversion: 2.1 time: 0.168630 Jan 24 09:23:27.554897 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 482/954] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:27 2022] GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6 => generated 1553 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:23:27.559335 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-937fd104-3be0-41be-95fd-1c0444f90eff tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:27.560073 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-937fd104-3be0-41be-95fd-1c0444f90eff tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f32748bf-320b-4cb5-9616-7c1d7260e260] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:27.612435 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-937fd104-3be0-41be-95fd-1c0444f90eff tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:27.619138 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-937fd104-3be0-41be-95fd-1c0444f90eff tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/f32748bf-320b-4cb5-9616-7c1d7260e260" status: 200 len: 1097 microversion: 2.1 time: 0.063244 Jan 24 09:23:27.619699 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 483/955] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:27 2022] GET /compute/v2.1/servers/f32748bf-320b-4cb5-9616-7c1d7260e260 => generated 1097 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:23:27.625104 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-74b74394-79b4-4331-ac48-36c648628e4d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:27.625668 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-74b74394-79b4-4331-ac48-36c648628e4d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:27.632048 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-74b74394-79b4-4331-ac48-36c648628e4d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:27.632674 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-74b74394-79b4-4331-ac48-36c648628e4d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:27.633688 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-a27b7713-6b4a-48ca-8a9f-9d54e3eab71e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action" status: 200 len: 37386 microversion: 2.20 time: 0.116395 Jan 24 09:23:27.633871 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-74b74394-79b4-4331-ac48-36c648628e4d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:27.634352 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 473/956] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:23:27 2022] POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action => generated 37386 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:23:27.637839 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-74b74394-79b4-4331-ac48-36c648628e4d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:27.716823 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-74b74394-79b4-4331-ac48-36c648628e4d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095443 Jan 24 09:23:27.717435 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 484/957] 10.222.0.113 () {58 vars in 1279 bytes} [Mon Jan 24 09:23:27 2022] GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:23:28.400985 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-3f17da3b-ec7d-43c2-8870-02449fca8f66 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:28.401697 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-3f17da3b-ec7d-43c2-8870-02449fca8f66 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] [instance: e0da7e40-72fc-4851-9b48-79c1a222755b] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:28.408604 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3f17da3b-ec7d-43c2-8870-02449fca8f66 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:28.409494 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3f17da3b-ec7d-43c2-8870-02449fca8f66 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:28.409841 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3f17da3b-ec7d-43c2-8870-02449fca8f66 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:28.410324 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3f17da3b-ec7d-43c2-8870-02449fca8f66 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:28.551976 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-3f17da3b-ec7d-43c2-8870-02449fca8f66 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6759ec2c684364a2a1ecfd5ee2a947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9934be44344de7ab0d0f94800506a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:28.560223 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-3f17da3b-ec7d-43c2-8870-02449fca8f66 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] 10.222.0.113 "GET /compute/v2.1/servers/e0da7e40-72fc-4851-9b48-79c1a222755b" status: 200 len: 1319 microversion: 2.1 time: 0.164113 Jan 24 09:23:28.560734 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 474/958] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:28 2022] GET /compute/v2.1/servers/e0da7e40-72fc-4851-9b48-79c1a222755b => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:23:28.636490 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-25fc0931-0524-4bf8-923f-c3c23805dfc2 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:28.637097 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-25fc0931-0524-4bf8-923f-c3c23805dfc2 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f32748bf-320b-4cb5-9616-7c1d7260e260] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:28.646150 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-25fc0931-0524-4bf8-923f-c3c23805dfc2 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:28.646600 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-25fc0931-0524-4bf8-923f-c3c23805dfc2 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:28.647384 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-25fc0931-0524-4bf8-923f-c3c23805dfc2 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:28.647593 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-34775a0f-ddbf-4dec-a021-e24645524944 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:28.647813 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-25fc0931-0524-4bf8-923f-c3c23805dfc2 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:28.648529 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-34775a0f-ddbf-4dec-a021-e24645524944 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:28.671765 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-34775a0f-ddbf-4dec-a021-e24645524944 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:28.672217 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-34775a0f-ddbf-4dec-a021-e24645524944 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:28.673038 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-34775a0f-ddbf-4dec-a021-e24645524944 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:28.673544 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-34775a0f-ddbf-4dec-a021-e24645524944 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:28.783476 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-34775a0f-ddbf-4dec-a021-e24645524944 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action" status: 200 len: 38202 microversion: 2.20 time: 0.141012 Jan 24 09:23:28.784160 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 475/959] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:23:28 2022] POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action => generated 38202 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:23:28.981876 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-25fc0931-0524-4bf8-923f-c3c23805dfc2 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:28.989074 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-25fc0931-0524-4bf8-923f-c3c23805dfc2 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/f32748bf-320b-4cb5-9616-7c1d7260e260" status: 200 len: 1147 microversion: 2.1 time: 0.356980 Jan 24 09:23:28.989577 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 485/960] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:28 2022] GET /compute/v2.1/servers/f32748bf-320b-4cb5-9616-7c1d7260e260 => generated 1147 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:23:29.076834 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-82345ffe-3d4c-4969-8dfa-d389eadb3839 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:29.077790 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-82345ffe-3d4c-4969-8dfa-d389eadb3839 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:29.078030 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [req-04f9b744-0605-44ba-b2f8-e932c76dc8c3 req-413eacaa-856a-4a76-b1c1-93f4be06fb43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3b808fd-b585-4062-a321-9965f704ffe6", "tag": "27389513-03ea-4e61-98b8-afb32fb7a007"}]} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:29.079972 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:23:29.079972 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: warnings.warn(msg) Jan 24 09:23:29.086983 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-82345ffe-3d4c-4969-8dfa-d389eadb3839 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:29.087408 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-04f9b744-0605-44ba-b2f8-e932c76dc8c3 req-413eacaa-856a-4a76-b1c1-93f4be06fb43 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:29.087519 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-82345ffe-3d4c-4969-8dfa-d389eadb3839 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:29.088031 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-04f9b744-0605-44ba-b2f8-e932c76dc8c3 req-413eacaa-856a-4a76-b1c1-93f4be06fb43 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:29.089586 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-82345ffe-3d4c-4969-8dfa-d389eadb3839 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:29.089586 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-82345ffe-3d4c-4969-8dfa-d389eadb3839 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:29.103005 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.compute.server_external_events [req-04f9b744-0605-44ba-b2f8-e932c76dc8c3 req-413eacaa-856a-4a76-b1c1-93f4be06fb43 service nova] Creating event network-changed:27389513-03ea-4e61-98b8-afb32fb7a007 for instance f3b808fd-b585-4062-a321-9965f704ffe6 on hv-cinder-80403 Jan 24 09:23:29.108702 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [req-04f9b744-0605-44ba-b2f8-e932c76dc8c3 req-413eacaa-856a-4a76-b1c1-93f4be06fb43 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034285 Jan 24 09:23:29.109884 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 486/961] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:23:29.342543 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-82345ffe-3d4c-4969-8dfa-d389eadb3839 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action" status: 200 len: 14 microversion: 2.1 time: 0.270874 Jan 24 09:23:29.343262 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 476/962] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:23:29 2022] POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action => generated 14 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 09:23:29.577434 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-28b75e9c-41c1-446f-9900-05f5b348d045 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:29.578402 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-28b75e9c-41c1-446f-9900-05f5b348d045 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] [instance: e0da7e40-72fc-4851-9b48-79c1a222755b] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:29.584990 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-28b75e9c-41c1-446f-9900-05f5b348d045 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:29.585764 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-28b75e9c-41c1-446f-9900-05f5b348d045 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:29.586860 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-28b75e9c-41c1-446f-9900-05f5b348d045 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:29.587611 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-28b75e9c-41c1-446f-9900-05f5b348d045 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:29.739329 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-28b75e9c-41c1-446f-9900-05f5b348d045 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6759ec2c684364a2a1ecfd5ee2a947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9934be44344de7ab0d0f94800506a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:29.748002 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-28b75e9c-41c1-446f-9900-05f5b348d045 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] 10.222.0.113 "GET /compute/v2.1/servers/e0da7e40-72fc-4851-9b48-79c1a222755b" status: 200 len: 1469 microversion: 2.1 time: 0.174687 Jan 24 09:23:29.752451 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 487/963] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:29 2022] GET /compute/v2.1/servers/e0da7e40-72fc-4851-9b48-79c1a222755b => generated 1469 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:23:29.797485 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-0edacca4-ce08-45ab-8042-e4175640aedf tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:29.802494 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-570dcd67-7e58-4951-8423-caae933a3de5 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:29.803953 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-570dcd67-7e58-4951-8423-caae933a3de5 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] [instance: e0da7e40-72fc-4851-9b48-79c1a222755b] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:29.807309 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-0edacca4-ce08-45ab-8042-e4175640aedf tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:29.813506 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-570dcd67-7e58-4951-8423-caae933a3de5 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:29.813953 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-570dcd67-7e58-4951-8423-caae933a3de5 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:29.818164 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-570dcd67-7e58-4951-8423-caae933a3de5 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:29.818611 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-570dcd67-7e58-4951-8423-caae933a3de5 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:29.820291 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0edacca4-ce08-45ab-8042-e4175640aedf tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:29.821859 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0edacca4-ce08-45ab-8042-e4175640aedf tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:29.825099 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0edacca4-ce08-45ab-8042-e4175640aedf tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:29.826907 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0edacca4-ce08-45ab-8042-e4175640aedf tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:29.856171 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-570dcd67-7e58-4951-8423-caae933a3de5 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] [instance: e0da7e40-72fc-4851-9b48-79c1a222755b] Going to try to terminate instance {{(pid=116863) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 09:23:29.927692 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-0edacca4-ce08-45ab-8042-e4175640aedf tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action" status: 200 len: 38204 microversion: 2.20 time: 0.134733 Jan 24 09:23:29.934703 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 477/964] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:23:29 2022] POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action => generated 38204 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:23:30.010428 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-08c49d4c-f615-48d3-8ab9-0986068f9325 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:30.011529 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-08c49d4c-f615-48d3-8ab9-0986068f9325 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f32748bf-320b-4cb5-9616-7c1d7260e260] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:30.020139 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-08c49d4c-f615-48d3-8ab9-0986068f9325 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:30.020705 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-08c49d4c-f615-48d3-8ab9-0986068f9325 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:30.021659 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-08c49d4c-f615-48d3-8ab9-0986068f9325 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:30.022198 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-08c49d4c-f615-48d3-8ab9-0986068f9325 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:30.094721 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-08c49d4c-f615-48d3-8ab9-0986068f9325 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:30.104499 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-08c49d4c-f615-48d3-8ab9-0986068f9325 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/f32748bf-320b-4cb5-9616-7c1d7260e260" status: 200 len: 1203 microversion: 2.1 time: 0.101368 Jan 24 09:23:30.105512 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 478/965] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:30 2022] GET /compute/v2.1/servers/f32748bf-320b-4cb5-9616-7c1d7260e260 => generated 1203 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:23:30.214351 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-570dcd67-7e58-4951-8423-caae933a3de5 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] 10.222.0.113 "DELETE /compute/v2.1/servers/e0da7e40-72fc-4851-9b48-79c1a222755b" status: 204 len: 0 microversion: 2.1 time: 0.420837 Jan 24 09:23:30.218897 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 488/966] 10.222.0.113 () {58 vars in 1243 bytes} [Mon Jan 24 09:23:29 2022] DELETE /compute/v2.1/servers/e0da7e40-72fc-4851-9b48-79c1a222755b => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 24 09:23:30.224182 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-0fc8c171-76a5-4238-aa40-a5f4e0594cd8 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:30.225144 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-0fc8c171-76a5-4238-aa40-a5f4e0594cd8 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] [instance: e0da7e40-72fc-4851-9b48-79c1a222755b] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:30.232934 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0fc8c171-76a5-4238-aa40-a5f4e0594cd8 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:30.233383 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0fc8c171-76a5-4238-aa40-a5f4e0594cd8 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:30.234209 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0fc8c171-76a5-4238-aa40-a5f4e0594cd8 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:30.234942 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0fc8c171-76a5-4238-aa40-a5f4e0594cd8 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:30.353685 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-c14a1d74-e81a-47f7-be89-3e029b2cfafd tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:30.354830 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-c14a1d74-e81a-47f7-be89-3e029b2cfafd tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:30.363132 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c14a1d74-e81a-47f7-be89-3e029b2cfafd tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:30.363710 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c14a1d74-e81a-47f7-be89-3e029b2cfafd tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:30.365555 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c14a1d74-e81a-47f7-be89-3e029b2cfafd tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:30.365555 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c14a1d74-e81a-47f7-be89-3e029b2cfafd tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:30.379203 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-0fc8c171-76a5-4238-aa40-a5f4e0594cd8 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6759ec2c684364a2a1ecfd5ee2a947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9934be44344de7ab0d0f94800506a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:30.392498 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-0fc8c171-76a5-4238-aa40-a5f4e0594cd8 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] 10.222.0.113 "GET /compute/v2.1/servers/e0da7e40-72fc-4851-9b48-79c1a222755b" status: 200 len: 1475 microversion: 2.1 time: 0.172289 Jan 24 09:23:30.396746 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 479/967] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:30 2022] GET /compute/v2.1/servers/e0da7e40-72fc-4851-9b48-79c1a222755b => generated 1475 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:23:30.460333 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-c14a1d74-e81a-47f7-be89-3e029b2cfafd tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action" status: 200 len: 14 microversion: 2.1 time: 0.110842 Jan 24 09:23:30.461131 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 489/968] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:23:30 2022] POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 24 09:23:30.943904 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-2d5aed86-67d9-4975-b4c7-cf6f52ac1f2e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:30.945219 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-2d5aed86-67d9-4975-b4c7-cf6f52ac1f2e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:30.954158 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2d5aed86-67d9-4975-b4c7-cf6f52ac1f2e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:30.954542 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2d5aed86-67d9-4975-b4c7-cf6f52ac1f2e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:30.955339 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2d5aed86-67d9-4975-b4c7-cf6f52ac1f2e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:30.955946 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2d5aed86-67d9-4975-b4c7-cf6f52ac1f2e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:31.053704 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-2d5aed86-67d9-4975-b4c7-cf6f52ac1f2e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action" status: 200 len: 38206 microversion: 2.20 time: 0.115351 Jan 24 09:23:31.054404 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 480/969] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:23:30 2022] POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action => generated 38206 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 09:23:31.122666 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-1535caab-cfbb-4538-9757-063cc8637228 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:31.123862 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-1535caab-cfbb-4538-9757-063cc8637228 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f32748bf-320b-4cb5-9616-7c1d7260e260] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:31.131666 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1535caab-cfbb-4538-9757-063cc8637228 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:31.132563 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1535caab-cfbb-4538-9757-063cc8637228 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:31.132966 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1535caab-cfbb-4538-9757-063cc8637228 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:31.133448 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1535caab-cfbb-4538-9757-063cc8637228 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:31.411490 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-a96cbe4b-b239-43b6-90af-52abd505b6ad tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:31.412428 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-a96cbe4b-b239-43b6-90af-52abd505b6ad tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] [instance: e0da7e40-72fc-4851-9b48-79c1a222755b] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:31.420536 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a96cbe4b-b239-43b6-90af-52abd505b6ad tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:31.420984 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a96cbe4b-b239-43b6-90af-52abd505b6ad tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:31.421767 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a96cbe4b-b239-43b6-90af-52abd505b6ad tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:31.422375 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a96cbe4b-b239-43b6-90af-52abd505b6ad tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:31.481244 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-1535caab-cfbb-4538-9757-063cc8637228 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:31.490597 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-1535caab-cfbb-4538-9757-063cc8637228 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/f32748bf-320b-4cb5-9616-7c1d7260e260" status: 200 len: 1281 microversion: 2.1 time: 0.372421 Jan 24 09:23:31.500699 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 490/970] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:31 2022] GET /compute/v2.1/servers/f32748bf-320b-4cb5-9616-7c1d7260e260 => generated 1281 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:23:31.500699 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-7ab8bc3f-0a6b-4f2b-b078-8fcfe60b84a4 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:31.500699 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-7ab8bc3f-0a6b-4f2b-b078-8fcfe60b84a4 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:31.503073 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7ab8bc3f-0a6b-4f2b-b078-8fcfe60b84a4 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:31.504161 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7ab8bc3f-0a6b-4f2b-b078-8fcfe60b84a4 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:31.504955 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7ab8bc3f-0a6b-4f2b-b078-8fcfe60b84a4 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:31.505386 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7ab8bc3f-0a6b-4f2b-b078-8fcfe60b84a4 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:31.578841 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-7ab8bc3f-0a6b-4f2b-b078-8fcfe60b84a4 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action" status: 200 len: 14 microversion: 2.1 time: 0.086428 Jan 24 09:23:31.579474 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 491/971] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:23:31 2022] POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 09:23:31.584431 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-a96cbe4b-b239-43b6-90af-52abd505b6ad tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6759ec2c684364a2a1ecfd5ee2a947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9934be44344de7ab0d0f94800506a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:31.592067 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-a96cbe4b-b239-43b6-90af-52abd505b6ad tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] 10.222.0.113 "GET /compute/v2.1/servers/e0da7e40-72fc-4851-9b48-79c1a222755b" status: 200 len: 1475 microversion: 2.1 time: 0.185354 Jan 24 09:23:31.592634 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 481/972] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:31 2022] GET /compute/v2.1/servers/e0da7e40-72fc-4851-9b48-79c1a222755b => generated 1475 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:23:32.067422 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-6ee74f83-9ca9-4301-bc14-1bb796ed82b5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:32.068750 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-6ee74f83-9ca9-4301-bc14-1bb796ed82b5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:32.075504 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [req-06054a3e-6780-492a-9587-39b2785ade64 req-eeb0be90-c31b-4213-9a97-cec90da2005f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f32748bf-320b-4cb5-9616-7c1d7260e260", "tag": "5759d870-5446-4073-a6bb-068adfd04ca4"}]} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:32.077505 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6ee74f83-9ca9-4301-bc14-1bb796ed82b5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:32.077904 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:23:32.077904 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: warnings.warn(msg) Jan 24 09:23:32.078166 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6ee74f83-9ca9-4301-bc14-1bb796ed82b5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:32.079375 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6ee74f83-9ca9-4301-bc14-1bb796ed82b5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:32.081669 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6ee74f83-9ca9-4301-bc14-1bb796ed82b5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:32.088934 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-06054a3e-6780-492a-9587-39b2785ade64 req-eeb0be90-c31b-4213-9a97-cec90da2005f service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:32.089631 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-06054a3e-6780-492a-9587-39b2785ade64 req-eeb0be90-c31b-4213-9a97-cec90da2005f service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:32.106210 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.compute.server_external_events [req-06054a3e-6780-492a-9587-39b2785ade64 req-eeb0be90-c31b-4213-9a97-cec90da2005f service nova] Creating event network-changed:5759d870-5446-4073-a6bb-068adfd04ca4 for instance f32748bf-320b-4cb5-9616-7c1d7260e260 on hv-cinder-80403 Jan 24 09:23:32.112231 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [req-06054a3e-6780-492a-9587-39b2785ade64 req-eeb0be90-c31b-4213-9a97-cec90da2005f service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041169 Jan 24 09:23:32.113024 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 482/973] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 09:23:32.191990 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-6ee74f83-9ca9-4301-bc14-1bb796ed82b5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action" status: 200 len: 38345 microversion: 2.20 time: 0.128548 Jan 24 09:23:32.193315 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 492/974] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:23:32 2022] POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action => generated 38345 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:23:32.212782 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-01be1668-c06b-46e8-af15-28e9a88cc838 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:32.212782 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-01be1668-c06b-46e8-af15-28e9a88cc838 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:32.215717 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-01be1668-c06b-46e8-af15-28e9a88cc838 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:32.216259 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-01be1668-c06b-46e8-af15-28e9a88cc838 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:32.217073 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-01be1668-c06b-46e8-af15-28e9a88cc838 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:32.217515 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-01be1668-c06b-46e8-af15-28e9a88cc838 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:32.245449 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-01be1668-c06b-46e8-af15-28e9a88cc838 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/ips" status: 200 len: 151 microversion: 2.20 time: 0.045144 Jan 24 09:23:32.246642 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 483/975] 10.222.0.113 () {60 vars in 1293 bytes} [Mon Jan 24 09:23:32 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/ips => generated 151 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 09:23:32.511414 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-bd247039-1a8e-43b9-9820-e39800574e26 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:32.512178 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-bd247039-1a8e-43b9-9820-e39800574e26 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f32748bf-320b-4cb5-9616-7c1d7260e260] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:32.522490 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bd247039-1a8e-43b9-9820-e39800574e26 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:32.523418 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bd247039-1a8e-43b9-9820-e39800574e26 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:32.525117 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bd247039-1a8e-43b9-9820-e39800574e26 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:32.525910 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bd247039-1a8e-43b9-9820-e39800574e26 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:32.590401 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-45887d0b-b7a4-4497-a138-14db92cdc616 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:32.591357 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-45887d0b-b7a4-4497-a138-14db92cdc616 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:32.605402 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-45887d0b-b7a4-4497-a138-14db92cdc616 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:32.608096 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-45887d0b-b7a4-4497-a138-14db92cdc616 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:32.608096 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-45887d0b-b7a4-4497-a138-14db92cdc616 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:32.608096 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-45887d0b-b7a4-4497-a138-14db92cdc616 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:32.676128 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-45887d0b-b7a4-4497-a138-14db92cdc616 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action" status: 200 len: 14 microversion: 2.1 time: 0.089984 Jan 24 09:23:32.676772 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 484/976] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:23:32 2022] POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 09:23:32.683868 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [req-69b7248c-c57e-4e84-99d9-6646bfdc697f req-958f179a-c080-46ab-8ccb-8103b588521e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0da7e40-72fc-4851-9b48-79c1a222755b", "name": "network-vif-deleted", "tag": "2c19c235-0e2f-4db9-aa73-c1e9f3c69ff3"}]} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:32.685702 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:23:32.685702 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: warnings.warn(msg) Jan 24 09:23:32.694268 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-69b7248c-c57e-4e84-99d9-6646bfdc697f req-958f179a-c080-46ab-8ccb-8103b588521e service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:32.695464 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-69b7248c-c57e-4e84-99d9-6646bfdc697f req-958f179a-c080-46ab-8ccb-8103b588521e service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:32.709105 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.compute.server_external_events [req-69b7248c-c57e-4e84-99d9-6646bfdc697f req-958f179a-c080-46ab-8ccb-8103b588521e service nova] Creating event network-vif-deleted:2c19c235-0e2f-4db9-aa73-c1e9f3c69ff3 for instance e0da7e40-72fc-4851-9b48-79c1a222755b on hv-cinder-80403 Jan 24 09:23:32.715926 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [req-69b7248c-c57e-4e84-99d9-6646bfdc697f req-958f179a-c080-46ab-8ccb-8103b588521e service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037585 Jan 24 09:23:32.716791 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 485/977] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:23:32.723169 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-4c7fb9f7-33ab-441b-b793-8e9266de8a2c tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:32.723868 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-4c7fb9f7-33ab-441b-b793-8e9266de8a2c tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] [instance: e0da7e40-72fc-4851-9b48-79c1a222755b] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:32.731695 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4c7fb9f7-33ab-441b-b793-8e9266de8a2c tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:32.732488 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4c7fb9f7-33ab-441b-b793-8e9266de8a2c tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:32.733635 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4c7fb9f7-33ab-441b-b793-8e9266de8a2c tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:32.734075 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4c7fb9f7-33ab-441b-b793-8e9266de8a2c tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:32.801788 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-4c7fb9f7-33ab-441b-b793-8e9266de8a2c tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6759ec2c684364a2a1ecfd5ee2a947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9934be44344de7ab0d0f94800506a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:32.810225 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-4c7fb9f7-33ab-441b-b793-8e9266de8a2c tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] 10.222.0.113 "GET /compute/v2.1/servers/e0da7e40-72fc-4851-9b48-79c1a222755b" status: 200 len: 1433 microversion: 2.1 time: 0.092061 Jan 24 09:23:32.810749 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 486/978] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:32 2022] GET /compute/v2.1/servers/e0da7e40-72fc-4851-9b48-79c1a222755b => generated 1433 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:23:32.816166 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-bd247039-1a8e-43b9-9820-e39800574e26 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:32.828496 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-bd247039-1a8e-43b9-9820-e39800574e26 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/f32748bf-320b-4cb5-9616-7c1d7260e260" status: 200 len: 1269 microversion: 2.1 time: 0.322767 Jan 24 09:23:32.829263 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 493/979] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:32 2022] GET /compute/v2.1/servers/f32748bf-320b-4cb5-9616-7c1d7260e260 => generated 1269 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:23:33.687697 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-97596648-b0e9-4608-aba9-a30816a2714f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:33.688618 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-97596648-b0e9-4608-aba9-a30816a2714f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:33.698396 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-97596648-b0e9-4608-aba9-a30816a2714f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:33.698396 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-97596648-b0e9-4608-aba9-a30816a2714f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:33.698396 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-97596648-b0e9-4608-aba9-a30816a2714f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:33.698396 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-97596648-b0e9-4608-aba9-a30816a2714f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:33.763837 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-97596648-b0e9-4608-aba9-a30816a2714f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action" status: 200 len: 14 microversion: 2.1 time: 0.079885 Jan 24 09:23:33.764482 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 487/980] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:23:33 2022] POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 09:23:33.829857 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-9e786d20-0f84-4336-a01d-35a7d1375cc4 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:33.830481 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-9e786d20-0f84-4336-a01d-35a7d1375cc4 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] [instance: e0da7e40-72fc-4851-9b48-79c1a222755b] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:33.836984 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9e786d20-0f84-4336-a01d-35a7d1375cc4 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:33.837582 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9e786d20-0f84-4336-a01d-35a7d1375cc4 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:33.838394 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9e786d20-0f84-4336-a01d-35a7d1375cc4 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:33.838836 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9e786d20-0f84-4336-a01d-35a7d1375cc4 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:33.846977 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-35286cbc-d106-417e-8cdc-2a04c30bfca0 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:33.847939 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-35286cbc-d106-417e-8cdc-2a04c30bfca0 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f32748bf-320b-4cb5-9616-7c1d7260e260] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:33.855623 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-35286cbc-d106-417e-8cdc-2a04c30bfca0 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:33.856080 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-35286cbc-d106-417e-8cdc-2a04c30bfca0 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:33.857064 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-35286cbc-d106-417e-8cdc-2a04c30bfca0 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:33.857683 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-35286cbc-d106-417e-8cdc-2a04c30bfca0 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:33.872992 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9e786d20-0f84-4336-a01d-35a7d1375cc4 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:33.873441 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9e786d20-0f84-4336-a01d-35a7d1375cc4 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:33.873895 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.objects.instance [None req-9e786d20-0f84-4336-a01d-35a7d1375cc4 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lazy-loading 'fault' on Instance uuid e0da7e40-72fc-4851-9b48-79c1a222755b {{(pid=116863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 09:23:33.925226 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-9e786d20-0f84-4336-a01d-35a7d1375cc4 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6759ec2c684364a2a1ecfd5ee2a947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9934be44344de7ab0d0f94800506a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:33.934581 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-9e786d20-0f84-4336-a01d-35a7d1375cc4 tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] 10.222.0.113 "GET /compute/v2.1/servers/e0da7e40-72fc-4851-9b48-79c1a222755b" status: 200 len: 1309 microversion: 2.1 time: 0.110255 Jan 24 09:23:33.938401 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 494/981] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:33 2022] GET /compute/v2.1/servers/e0da7e40-72fc-4851-9b48-79c1a222755b => generated 1309 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:23:34.023134 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-35286cbc-d106-417e-8cdc-2a04c30bfca0 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:34.031169 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-35286cbc-d106-417e-8cdc-2a04c30bfca0 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/f32748bf-320b-4cb5-9616-7c1d7260e260" status: 200 len: 1269 microversion: 2.1 time: 0.188289 Jan 24 09:23:34.031735 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 488/982] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:33 2022] GET /compute/v2.1/servers/f32748bf-320b-4cb5-9616-7c1d7260e260 => generated 1269 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:23:34.675373 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-7515876e-c486-4240-a663-72f6ec21593a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:34.675939 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-7515876e-c486-4240-a663-72f6ec21593a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:34.682390 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7515876e-c486-4240-a663-72f6ec21593a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:34.682845 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7515876e-c486-4240-a663-72f6ec21593a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:34.683630 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7515876e-c486-4240-a663-72f6ec21593a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:34.684073 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7515876e-c486-4240-a663-72f6ec21593a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:34.707114 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.objects.instance [None req-7515876e-c486-4240-a663-72f6ec21593a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lazy-loading 'flavor' on Instance uuid ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 {{(pid=116863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 09:23:34.780116 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-fb0eeee5-7908-4a5b-8f16-83fb1c484252 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:34.781024 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-fb0eeee5-7908-4a5b-8f16-83fb1c484252 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:34.787231 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fb0eeee5-7908-4a5b-8f16-83fb1c484252 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:34.787672 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fb0eeee5-7908-4a5b-8f16-83fb1c484252 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:34.788449 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fb0eeee5-7908-4a5b-8f16-83fb1c484252 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:34.788874 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fb0eeee5-7908-4a5b-8f16-83fb1c484252 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:34.855410 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-fb0eeee5-7908-4a5b-8f16-83fb1c484252 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action" status: 200 len: 14 microversion: 2.1 time: 0.078767 Jan 24 09:23:34.856050 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 489/983] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:23:34 2022] POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 24 09:23:34.952890 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-21939643-d4a3-47be-973c-87a1c836c87a tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:34.953517 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-21939643-d4a3-47be-973c-87a1c836c87a tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] [instance: e0da7e40-72fc-4851-9b48-79c1a222755b] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:34.960545 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-21939643-d4a3-47be-973c-87a1c836c87a tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:34.960998 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-21939643-d4a3-47be-973c-87a1c836c87a tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:34.962441 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-21939643-d4a3-47be-973c-87a1c836c87a tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:34.962881 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-21939643-d4a3-47be-973c-87a1c836c87a tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:34.978036 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.wsgi [None req-21939643-d4a3-47be-973c-87a1c836c87a tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] HTTP exception thrown: Instance e0da7e40-72fc-4851-9b48-79c1a222755b could not be found. Jan 24 09:23:34.978653 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-21939643-d4a3-47be-973c-87a1c836c87a tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] Returning 404 to user: Instance e0da7e40-72fc-4851-9b48-79c1a222755b could not be found. {{(pid=116864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:23:34.979466 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-21939643-d4a3-47be-973c-87a1c836c87a tempest-VolumesNegativeTest-361993377 tempest-VolumesNegativeTest-361993377-project] 10.222.0.113 "GET /compute/v2.1/servers/e0da7e40-72fc-4851-9b48-79c1a222755b" status: 404 len: 111 microversion: 2.1 time: 0.030729 Jan 24 09:23:34.979998 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 490/984] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:34 2022] GET /compute/v2.1/servers/e0da7e40-72fc-4851-9b48-79c1a222755b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 24 09:23:35.048190 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-b6093337-65fd-47ef-8abe-167c28649be9 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:35.048808 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-b6093337-65fd-47ef-8abe-167c28649be9 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f32748bf-320b-4cb5-9616-7c1d7260e260] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:35.055814 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b6093337-65fd-47ef-8abe-167c28649be9 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:35.056273 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b6093337-65fd-47ef-8abe-167c28649be9 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:35.057128 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b6093337-65fd-47ef-8abe-167c28649be9 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:35.057571 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b6093337-65fd-47ef-8abe-167c28649be9 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:35.195118 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-b6093337-65fd-47ef-8abe-167c28649be9 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:35.220376 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-b6093337-65fd-47ef-8abe-167c28649be9 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/f32748bf-320b-4cb5-9616-7c1d7260e260" status: 200 len: 1269 microversion: 2.1 time: 0.158577 Jan 24 09:23:35.220376 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 491/985] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:35 2022] GET /compute/v2.1/servers/f32748bf-320b-4cb5-9616-7c1d7260e260 => generated 1269 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:23:35.337523 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-7515876e-c486-4240-a663-72f6ec21593a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action" status: 202 len: 0 microversion: 2.20 time: 0.665687 Jan 24 09:23:35.341145 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 495/986] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:23:34 2022] POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action => generated 0 bytes in 667 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 24 09:23:35.346117 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-aa046959-3a54-434f-9287-6458b0beeec3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:35.346725 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-aa046959-3a54-434f-9287-6458b0beeec3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:35.353720 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-aa046959-3a54-434f-9287-6458b0beeec3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:35.354218 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-aa046959-3a54-434f-9287-6458b0beeec3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:35.355047 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-aa046959-3a54-434f-9287-6458b0beeec3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:35.355468 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-aa046959-3a54-434f-9287-6458b0beeec3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:35.490997 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-aa046959-3a54-434f-9287-6458b0beeec3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:35.500119 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-aa046959-3a54-434f-9287-6458b0beeec3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:35.501661 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-aa046959-3a54-434f-9287-6458b0beeec3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:35.502970 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-aa046959-3a54-434f-9287-6458b0beeec3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1725 microversion: 2.20 time: 0.160523 Jan 24 09:23:35.503538 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 492/987] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:23:35 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:23:35.867299 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-89fdfdc8-1d73-4b52-bafb-c4d720f49078 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:35.868382 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-89fdfdc8-1d73-4b52-bafb-c4d720f49078 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:35.875058 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-89fdfdc8-1d73-4b52-bafb-c4d720f49078 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:35.875559 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-89fdfdc8-1d73-4b52-bafb-c4d720f49078 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:35.876350 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-89fdfdc8-1d73-4b52-bafb-c4d720f49078 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:35.876831 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-89fdfdc8-1d73-4b52-bafb-c4d720f49078 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:35.962430 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-89fdfdc8-1d73-4b52-bafb-c4d720f49078 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action" status: 200 len: 14 microversion: 2.1 time: 0.099130 Jan 24 09:23:35.963255 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 496/988] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:23:35 2022] POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 09:23:36.219939 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-dcdb559d-88fe-4b82-b642-46f46533422b tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:36.220558 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-dcdb559d-88fe-4b82-b642-46f46533422b tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f32748bf-320b-4cb5-9616-7c1d7260e260] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:36.227486 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-dcdb559d-88fe-4b82-b642-46f46533422b tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:36.227967 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-dcdb559d-88fe-4b82-b642-46f46533422b tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:36.228867 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-dcdb559d-88fe-4b82-b642-46f46533422b tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:36.229979 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-dcdb559d-88fe-4b82-b642-46f46533422b tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:36.371242 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-dcdb559d-88fe-4b82-b642-46f46533422b tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:36.378637 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-dcdb559d-88fe-4b82-b642-46f46533422b tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/f32748bf-320b-4cb5-9616-7c1d7260e260" status: 200 len: 1269 microversion: 2.1 time: 0.162825 Jan 24 09:23:36.379207 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 493/989] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:36 2022] GET /compute/v2.1/servers/f32748bf-320b-4cb5-9616-7c1d7260e260 => generated 1269 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:23:36.521948 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-4604ff76-2410-4654-a772-9277eab5e7a5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:36.522791 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-4604ff76-2410-4654-a772-9277eab5e7a5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:36.531502 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4604ff76-2410-4654-a772-9277eab5e7a5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:36.537129 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4604ff76-2410-4654-a772-9277eab5e7a5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:36.537129 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4604ff76-2410-4654-a772-9277eab5e7a5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:36.537129 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4604ff76-2410-4654-a772-9277eab5e7a5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:36.683136 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-4604ff76-2410-4654-a772-9277eab5e7a5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:36.690999 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-4604ff76-2410-4654-a772-9277eab5e7a5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:36.692592 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-4604ff76-2410-4654-a772-9277eab5e7a5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:36.693719 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-4604ff76-2410-4654-a772-9277eab5e7a5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1725 microversion: 2.20 time: 0.176061 Jan 24 09:23:36.694298 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 497/990] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:23:36 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:23:36.973126 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-6bd005d4-4b08-4740-8145-fa09e3e08b79 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:36.974057 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-6bd005d4-4b08-4740-8145-fa09e3e08b79 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:36.980309 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6bd005d4-4b08-4740-8145-fa09e3e08b79 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:36.980760 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6bd005d4-4b08-4740-8145-fa09e3e08b79 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:36.981542 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6bd005d4-4b08-4740-8145-fa09e3e08b79 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:36.981982 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6bd005d4-4b08-4740-8145-fa09e3e08b79 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:37.058827 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-6bd005d4-4b08-4740-8145-fa09e3e08b79 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action" status: 200 len: 14 microversion: 2.1 time: 0.089192 Jan 24 09:23:37.059476 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 494/991] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:23:36 2022] POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 09:23:37.396397 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-597a93d8-cfec-475f-baf8-37e0ca794aa6 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:37.397000 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-597a93d8-cfec-475f-baf8-37e0ca794aa6 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f32748bf-320b-4cb5-9616-7c1d7260e260] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:37.404726 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-597a93d8-cfec-475f-baf8-37e0ca794aa6 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:37.405086 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-597a93d8-cfec-475f-baf8-37e0ca794aa6 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:37.405875 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-597a93d8-cfec-475f-baf8-37e0ca794aa6 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:37.406657 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-597a93d8-cfec-475f-baf8-37e0ca794aa6 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:37.550655 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-597a93d8-cfec-475f-baf8-37e0ca794aa6 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:37.558037 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-597a93d8-cfec-475f-baf8-37e0ca794aa6 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/f32748bf-320b-4cb5-9616-7c1d7260e260" status: 200 len: 1269 microversion: 2.1 time: 0.165350 Jan 24 09:23:37.559374 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 498/992] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:37 2022] GET /compute/v2.1/servers/f32748bf-320b-4cb5-9616-7c1d7260e260 => generated 1269 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:23:37.713748 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-117cce6f-9b46-4bfa-9b7f-7685ca74963d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:37.714506 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-117cce6f-9b46-4bfa-9b7f-7685ca74963d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:37.721321 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-117cce6f-9b46-4bfa-9b7f-7685ca74963d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:37.721764 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-117cce6f-9b46-4bfa-9b7f-7685ca74963d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:37.722586 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-117cce6f-9b46-4bfa-9b7f-7685ca74963d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:37.723015 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-117cce6f-9b46-4bfa-9b7f-7685ca74963d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:37.857927 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-117cce6f-9b46-4bfa-9b7f-7685ca74963d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:37.865734 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-117cce6f-9b46-4bfa-9b7f-7685ca74963d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:37.867502 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-117cce6f-9b46-4bfa-9b7f-7685ca74963d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:37.869554 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-117cce6f-9b46-4bfa-9b7f-7685ca74963d tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1725 microversion: 2.20 time: 0.160306 Jan 24 09:23:37.869768 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 495/993] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:23:37 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:23:38.071305 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-5bf152fe-2fb7-4159-8554-7d54a68b6e38 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:38.072302 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-5bf152fe-2fb7-4159-8554-7d54a68b6e38 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:38.079209 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5bf152fe-2fb7-4159-8554-7d54a68b6e38 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:38.079573 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5bf152fe-2fb7-4159-8554-7d54a68b6e38 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:38.080374 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5bf152fe-2fb7-4159-8554-7d54a68b6e38 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:38.080809 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5bf152fe-2fb7-4159-8554-7d54a68b6e38 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:38.151333 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-5bf152fe-2fb7-4159-8554-7d54a68b6e38 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action" status: 200 len: 14 microversion: 2.1 time: 0.085019 Jan 24 09:23:38.151969 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 499/994] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:23:38 2022] POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 09:23:38.575622 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-d4afa26d-41e0-4581-acb3-483b05229860 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:38.576184 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-d4afa26d-41e0-4581-acb3-483b05229860 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f32748bf-320b-4cb5-9616-7c1d7260e260] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:38.582692 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d4afa26d-41e0-4581-acb3-483b05229860 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:38.583138 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d4afa26d-41e0-4581-acb3-483b05229860 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:38.583935 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d4afa26d-41e0-4581-acb3-483b05229860 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:38.584367 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d4afa26d-41e0-4581-acb3-483b05229860 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:38.740302 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-d4afa26d-41e0-4581-acb3-483b05229860 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:38.749274 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-d4afa26d-41e0-4581-acb3-483b05229860 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/f32748bf-320b-4cb5-9616-7c1d7260e260" status: 200 len: 1269 microversion: 2.1 time: 0.177356 Jan 24 09:23:38.750163 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 496/995] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:38 2022] GET /compute/v2.1/servers/f32748bf-320b-4cb5-9616-7c1d7260e260 => generated 1269 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:23:38.887937 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-780c7eb4-4ddf-463e-b85b-ff23d7e39689 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:38.888626 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-780c7eb4-4ddf-463e-b85b-ff23d7e39689 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:38.895781 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-780c7eb4-4ddf-463e-b85b-ff23d7e39689 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:38.896228 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-780c7eb4-4ddf-463e-b85b-ff23d7e39689 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:38.897010 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-780c7eb4-4ddf-463e-b85b-ff23d7e39689 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:38.897436 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-780c7eb4-4ddf-463e-b85b-ff23d7e39689 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:39.034664 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-780c7eb4-4ddf-463e-b85b-ff23d7e39689 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:39.043536 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-780c7eb4-4ddf-463e-b85b-ff23d7e39689 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:39.045037 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-780c7eb4-4ddf-463e-b85b-ff23d7e39689 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:39.046235 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-780c7eb4-4ddf-463e-b85b-ff23d7e39689 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1725 microversion: 2.20 time: 0.162894 Jan 24 09:23:39.046805 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 500/996] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:23:38 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:23:39.162076 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-e478e8e1-48be-4462-a8d1-b2e4f9d74e05 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:39.163055 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-e478e8e1-48be-4462-a8d1-b2e4f9d74e05 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:39.170326 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e478e8e1-48be-4462-a8d1-b2e4f9d74e05 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:39.170788 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e478e8e1-48be-4462-a8d1-b2e4f9d74e05 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:39.171582 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e478e8e1-48be-4462-a8d1-b2e4f9d74e05 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:39.172051 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e478e8e1-48be-4462-a8d1-b2e4f9d74e05 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:39.247865 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-e478e8e1-48be-4462-a8d1-b2e4f9d74e05 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action" status: 200 len: 14 microversion: 2.1 time: 0.089416 Jan 24 09:23:39.248488 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 497/997] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:23:39 2022] POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 09:23:39.774128 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-bcb3e67d-556b-41e9-8ed4-f6c0fbf3a7aa tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:39.774914 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-bcb3e67d-556b-41e9-8ed4-f6c0fbf3a7aa tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f32748bf-320b-4cb5-9616-7c1d7260e260] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:39.781152 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bcb3e67d-556b-41e9-8ed4-f6c0fbf3a7aa tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:39.781604 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bcb3e67d-556b-41e9-8ed4-f6c0fbf3a7aa tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:39.782485 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bcb3e67d-556b-41e9-8ed4-f6c0fbf3a7aa tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:39.782930 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-bcb3e67d-556b-41e9-8ed4-f6c0fbf3a7aa tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:39.942743 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-bcb3e67d-556b-41e9-8ed4-f6c0fbf3a7aa tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:39.942743 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-bcb3e67d-556b-41e9-8ed4-f6c0fbf3a7aa tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/f32748bf-320b-4cb5-9616-7c1d7260e260" status: 200 len: 1269 microversion: 2.1 time: 0.170039 Jan 24 09:23:39.942743 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 501/998] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:39 2022] GET /compute/v2.1/servers/f32748bf-320b-4cb5-9616-7c1d7260e260 => generated 1269 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:23:40.067056 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-51262f8b-3ecf-4be1-a79d-67c81c4ef92e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:40.068353 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-51262f8b-3ecf-4be1-a79d-67c81c4ef92e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:40.076056 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-51262f8b-3ecf-4be1-a79d-67c81c4ef92e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:40.076571 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-51262f8b-3ecf-4be1-a79d-67c81c4ef92e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:40.077435 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-51262f8b-3ecf-4be1-a79d-67c81c4ef92e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:40.077951 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-51262f8b-3ecf-4be1-a79d-67c81c4ef92e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:40.219182 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-51262f8b-3ecf-4be1-a79d-67c81c4ef92e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:40.227458 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-51262f8b-3ecf-4be1-a79d-67c81c4ef92e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:40.229297 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-51262f8b-3ecf-4be1-a79d-67c81c4ef92e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:40.230571 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-51262f8b-3ecf-4be1-a79d-67c81c4ef92e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1725 microversion: 2.20 time: 0.168098 Jan 24 09:23:40.231138 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 498/999] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:23:40 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:23:40.258679 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-30859fc1-4a17-43f5-9fec-65d89febd759 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:40.260386 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-30859fc1-4a17-43f5-9fec-65d89febd759 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:40.266732 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-30859fc1-4a17-43f5-9fec-65d89febd759 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:40.267182 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-30859fc1-4a17-43f5-9fec-65d89febd759 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:40.267974 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-30859fc1-4a17-43f5-9fec-65d89febd759 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:40.268410 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-30859fc1-4a17-43f5-9fec-65d89febd759 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:40.341441 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-30859fc1-4a17-43f5-9fec-65d89febd759 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action" status: 200 len: 14 microversion: 2.1 time: 0.086287 Jan 24 09:23:40.342426 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 502/1000] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:23:40 2022] POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 09:23:40.956535 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-8eb42f69-e5af-4811-a983-98416b99a297 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:40.957150 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-8eb42f69-e5af-4811-a983-98416b99a297 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f32748bf-320b-4cb5-9616-7c1d7260e260] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:40.964583 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-8eb42f69-e5af-4811-a983-98416b99a297 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:40.965050 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-8eb42f69-e5af-4811-a983-98416b99a297 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:40.966029 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-8eb42f69-e5af-4811-a983-98416b99a297 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:40.966417 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-8eb42f69-e5af-4811-a983-98416b99a297 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:41.104899 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-8eb42f69-e5af-4811-a983-98416b99a297 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:41.112340 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-8eb42f69-e5af-4811-a983-98416b99a297 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/f32748bf-320b-4cb5-9616-7c1d7260e260" status: 200 len: 1269 microversion: 2.1 time: 0.159458 Jan 24 09:23:41.112906 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 499/1001] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:40 2022] GET /compute/v2.1/servers/f32748bf-320b-4cb5-9616-7c1d7260e260 => generated 1269 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:23:41.249960 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-48439dae-b48c-42f4-82e6-42153e373dc7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:41.250683 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-48439dae-b48c-42f4-82e6-42153e373dc7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:41.257612 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-48439dae-b48c-42f4-82e6-42153e373dc7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:41.262641 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-48439dae-b48c-42f4-82e6-42153e373dc7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:41.262641 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-48439dae-b48c-42f4-82e6-42153e373dc7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:41.262641 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-48439dae-b48c-42f4-82e6-42153e373dc7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:41.352345 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-da1460ef-7fc9-47cd-bada-40289b0f7d1a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:41.354113 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-da1460ef-7fc9-47cd-bada-40289b0f7d1a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:41.360660 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-da1460ef-7fc9-47cd-bada-40289b0f7d1a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:41.361105 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-da1460ef-7fc9-47cd-bada-40289b0f7d1a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:41.361892 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-da1460ef-7fc9-47cd-bada-40289b0f7d1a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:41.362345 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-da1460ef-7fc9-47cd-bada-40289b0f7d1a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:41.395744 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-48439dae-b48c-42f4-82e6-42153e373dc7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:41.404130 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-48439dae-b48c-42f4-82e6-42153e373dc7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:41.405711 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-48439dae-b48c-42f4-82e6-42153e373dc7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:41.406908 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-48439dae-b48c-42f4-82e6-42153e373dc7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1725 microversion: 2.20 time: 0.161119 Jan 24 09:23:41.407477 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 503/1002] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:23:41 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 09:23:41.434535 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-da1460ef-7fc9-47cd-bada-40289b0f7d1a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action" status: 200 len: 14 microversion: 2.1 time: 0.085481 Jan 24 09:23:41.435121 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 500/1003] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:23:41 2022] POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 24 09:23:42.129224 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-f75afa40-cd8c-4517-acc8-519d3121c40f tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:42.130345 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-f75afa40-cd8c-4517-acc8-519d3121c40f tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f32748bf-320b-4cb5-9616-7c1d7260e260] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:42.137712 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f75afa40-cd8c-4517-acc8-519d3121c40f tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:42.138407 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f75afa40-cd8c-4517-acc8-519d3121c40f tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:42.139199 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f75afa40-cd8c-4517-acc8-519d3121c40f tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:42.139642 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f75afa40-cd8c-4517-acc8-519d3121c40f tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:42.280949 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-f75afa40-cd8c-4517-acc8-519d3121c40f tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:42.293144 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-f75afa40-cd8c-4517-acc8-519d3121c40f tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/f32748bf-320b-4cb5-9616-7c1d7260e260" status: 200 len: 1269 microversion: 2.1 time: 0.163728 Jan 24 09:23:42.293144 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 504/1004] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:42 2022] GET /compute/v2.1/servers/f32748bf-320b-4cb5-9616-7c1d7260e260 => generated 1269 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:23:42.426517 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-5b6b13ee-58ae-45fe-9937-914ae806b41f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:42.427074 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-5b6b13ee-58ae-45fe-9937-914ae806b41f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:42.433043 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [req-e0e589a7-8354-47cb-9b8a-e5253d6268d0 req-a85cc362-2f40-4cce-b886-6caf6ad868f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f32748bf-320b-4cb5-9616-7c1d7260e260", "name": "network-vif-plugged", "status": "completed", "tag": "5759d870-5446-4073-a6bb-068adfd04ca4"}]} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:42.434634 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:23:42.434634 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: warnings.warn(msg) Jan 24 09:23:42.434851 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5b6b13ee-58ae-45fe-9937-914ae806b41f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:42.435115 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5b6b13ee-58ae-45fe-9937-914ae806b41f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:42.436375 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5b6b13ee-58ae-45fe-9937-914ae806b41f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:42.436844 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5b6b13ee-58ae-45fe-9937-914ae806b41f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:42.451310 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-e0e589a7-8354-47cb-9b8a-e5253d6268d0 req-a85cc362-2f40-4cce-b886-6caf6ad868f9 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:42.451761 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-e0e589a7-8354-47cb-9b8a-e5253d6268d0 req-a85cc362-2f40-4cce-b886-6caf6ad868f9 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:42.463214 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.compute.server_external_events [req-e0e589a7-8354-47cb-9b8a-e5253d6268d0 req-a85cc362-2f40-4cce-b886-6caf6ad868f9 service nova] Creating event network-vif-plugged:5759d870-5446-4073-a6bb-068adfd04ca4 for instance f32748bf-320b-4cb5-9616-7c1d7260e260 on hv-cinder-80403 Jan 24 09:23:42.468071 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [req-e0e589a7-8354-47cb-9b8a-e5253d6268d0 req-a85cc362-2f40-4cce-b886-6caf6ad868f9 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039606 Jan 24 09:23:42.468954 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 505/1005] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:23:42.473543 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-e761677b-19d9-4da7-a879-5986ad8a806b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:42.474581 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-e761677b-19d9-4da7-a879-5986ad8a806b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:42.481251 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e761677b-19d9-4da7-a879-5986ad8a806b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:42.481618 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e761677b-19d9-4da7-a879-5986ad8a806b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:42.482455 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e761677b-19d9-4da7-a879-5986ad8a806b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:42.482887 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e761677b-19d9-4da7-a879-5986ad8a806b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:42.551550 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-e761677b-19d9-4da7-a879-5986ad8a806b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action" status: 200 len: 14 microversion: 2.1 time: 0.081418 Jan 24 09:23:42.554659 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 506/1006] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:23:42 2022] POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 09:23:42.600326 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-5b6b13ee-58ae-45fe-9937-914ae806b41f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:42.609398 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-5b6b13ee-58ae-45fe-9937-914ae806b41f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:42.610952 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-5b6b13ee-58ae-45fe-9937-914ae806b41f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:42.612126 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-5b6b13ee-58ae-45fe-9937-914ae806b41f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1725 microversion: 2.20 time: 0.189935 Jan 24 09:23:42.624146 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 501/1007] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:23:42 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1725 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:23:43.307052 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-22e307df-aab7-435a-8646-1b315ee46d23 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:43.307763 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-22e307df-aab7-435a-8646-1b315ee46d23 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f32748bf-320b-4cb5-9616-7c1d7260e260] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:43.314586 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-22e307df-aab7-435a-8646-1b315ee46d23 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:43.315040 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-22e307df-aab7-435a-8646-1b315ee46d23 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:43.315826 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-22e307df-aab7-435a-8646-1b315ee46d23 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:43.316263 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-22e307df-aab7-435a-8646-1b315ee46d23 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:43.511201 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-22e307df-aab7-435a-8646-1b315ee46d23 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:43.518746 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-22e307df-aab7-435a-8646-1b315ee46d23 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/f32748bf-320b-4cb5-9616-7c1d7260e260" status: 200 len: 1269 microversion: 2.1 time: 0.215764 Jan 24 09:23:43.520581 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 507/1008] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:43 2022] GET /compute/v2.1/servers/f32748bf-320b-4cb5-9616-7c1d7260e260 => generated 1269 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:23:43.562221 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-af128813-806e-49b8-9eb3-c554014b8294 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:43.563738 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-af128813-806e-49b8-9eb3-c554014b8294 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:43.570714 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-af128813-806e-49b8-9eb3-c554014b8294 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:43.570893 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-af128813-806e-49b8-9eb3-c554014b8294 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:43.572214 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-af128813-806e-49b8-9eb3-c554014b8294 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:43.572659 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-af128813-806e-49b8-9eb3-c554014b8294 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:43.631631 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-c00b2ab5-a355-4071-adfa-af33973625d8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:43.632239 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-c00b2ab5-a355-4071-adfa-af33973625d8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:43.639861 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c00b2ab5-a355-4071-adfa-af33973625d8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:43.640322 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c00b2ab5-a355-4071-adfa-af33973625d8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:43.641103 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c00b2ab5-a355-4071-adfa-af33973625d8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:43.641547 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c00b2ab5-a355-4071-adfa-af33973625d8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:43.656333 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-af128813-806e-49b8-9eb3-c554014b8294 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action" status: 200 len: 7546 microversion: 2.1 time: 0.097790 Jan 24 09:23:43.656952 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 502/1009] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:23:43 2022] POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action => generated 7546 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:23:43.862818 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-c00b2ab5-a355-4071-adfa-af33973625d8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:43.871726 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-c00b2ab5-a355-4071-adfa-af33973625d8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:43.873227 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-c00b2ab5-a355-4071-adfa-af33973625d8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:43.874421 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-c00b2ab5-a355-4071-adfa-af33973625d8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1725 microversion: 2.20 time: 0.246506 Jan 24 09:23:43.874997 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 508/1010] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:23:43 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1725 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 09:23:44.537768 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-c0af038b-5139-4128-812f-cdf80863f30b tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:44.538597 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-c0af038b-5139-4128-812f-cdf80863f30b tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f32748bf-320b-4cb5-9616-7c1d7260e260] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:44.547230 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c0af038b-5139-4128-812f-cdf80863f30b tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:44.547693 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c0af038b-5139-4128-812f-cdf80863f30b tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:44.548545 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c0af038b-5139-4128-812f-cdf80863f30b tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:44.549077 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c0af038b-5139-4128-812f-cdf80863f30b tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:44.666300 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-4c64c155-4424-4ea5-89cc-2b195ff5df98 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:44.668105 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-4c64c155-4424-4ea5-89cc-2b195ff5df98 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:44.674916 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4c64c155-4424-4ea5-89cc-2b195ff5df98 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:44.675524 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4c64c155-4424-4ea5-89cc-2b195ff5df98 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:44.676547 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4c64c155-4424-4ea5-89cc-2b195ff5df98 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:44.677057 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4c64c155-4424-4ea5-89cc-2b195ff5df98 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:44.691502 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-c0af038b-5139-4128-812f-cdf80863f30b tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:44.700720 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-c0af038b-5139-4128-812f-cdf80863f30b tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/f32748bf-320b-4cb5-9616-7c1d7260e260" status: 200 len: 1457 microversion: 2.1 time: 0.167457 Jan 24 09:23:44.701211 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 503/1011] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:44 2022] GET /compute/v2.1/servers/f32748bf-320b-4cb5-9616-7c1d7260e260 => generated 1457 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:23:44.717660 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-f1276962-b281-44b8-846a-c3e19f0a2c0d tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:44.727260 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-f1276962-b281-44b8-846a-c3e19f0a2c0d tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f32748bf-320b-4cb5-9616-7c1d7260e260] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:44.727260 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f1276962-b281-44b8-846a-c3e19f0a2c0d tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:44.727260 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f1276962-b281-44b8-846a-c3e19f0a2c0d tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:44.727260 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f1276962-b281-44b8-846a-c3e19f0a2c0d tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:44.727654 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f1276962-b281-44b8-846a-c3e19f0a2c0d tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:44.762077 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-4c64c155-4424-4ea5-89cc-2b195ff5df98 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action" status: 200 len: 15025 microversion: 2.1 time: 0.099266 Jan 24 09:23:44.762756 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 509/1012] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:23:44 2022] POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action => generated 15025 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:23:44.860691 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-f1276962-b281-44b8-846a-c3e19f0a2c0d tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:44.867920 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-f1276962-b281-44b8-846a-c3e19f0a2c0d tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/f32748bf-320b-4cb5-9616-7c1d7260e260" status: 200 len: 1457 microversion: 2.1 time: 0.154683 Jan 24 09:23:44.868489 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 504/1013] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:44 2022] GET /compute/v2.1/servers/f32748bf-320b-4cb5-9616-7c1d7260e260 => generated 1457 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:23:44.893437 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-e3f6b5c9-c6f5-4c0a-b0e6-a5f5bac84f8f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:44.894189 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-e3f6b5c9-c6f5-4c0a-b0e6-a5f5bac84f8f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:44.901131 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e3f6b5c9-c6f5-4c0a-b0e6-a5f5bac84f8f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:44.901713 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e3f6b5c9-c6f5-4c0a-b0e6-a5f5bac84f8f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:44.902793 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e3f6b5c9-c6f5-4c0a-b0e6-a5f5bac84f8f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:44.903212 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e3f6b5c9-c6f5-4c0a-b0e6-a5f5bac84f8f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:45.050121 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-e3f6b5c9-c6f5-4c0a-b0e6-a5f5bac84f8f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:45.058976 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-e3f6b5c9-c6f5-4c0a-b0e6-a5f5bac84f8f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:45.060507 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-e3f6b5c9-c6f5-4c0a-b0e6-a5f5bac84f8f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:45.061718 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-e3f6b5c9-c6f5-4c0a-b0e6-a5f5bac84f8f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1725 microversion: 2.20 time: 0.172455 Jan 24 09:23:45.062327 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 510/1014] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:23:44 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:23:45.773076 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-93ff4b48-bf09-43be-bf2d-79935a7cc39c tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:45.774792 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-93ff4b48-bf09-43be-bf2d-79935a7cc39c tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:45.781311 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-93ff4b48-bf09-43be-bf2d-79935a7cc39c tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:45.781844 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-93ff4b48-bf09-43be-bf2d-79935a7cc39c tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:45.782916 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-93ff4b48-bf09-43be-bf2d-79935a7cc39c tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:45.783344 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-93ff4b48-bf09-43be-bf2d-79935a7cc39c tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:45.879433 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-93ff4b48-bf09-43be-bf2d-79935a7cc39c tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action" status: 200 len: 18356 microversion: 2.1 time: 0.110043 Jan 24 09:23:45.880001 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 505/1015] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:23:45 2022] POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action => generated 18356 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:23:46.080168 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-b3772baf-f535-4083-a729-d680f0be37d8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:46.080784 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-b3772baf-f535-4083-a729-d680f0be37d8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:46.087337 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b3772baf-f535-4083-a729-d680f0be37d8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:46.087788 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b3772baf-f535-4083-a729-d680f0be37d8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:46.088644 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b3772baf-f535-4083-a729-d680f0be37d8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:46.089899 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b3772baf-f535-4083-a729-d680f0be37d8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:46.319698 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-b3772baf-f535-4083-a729-d680f0be37d8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:46.328930 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-b3772baf-f535-4083-a729-d680f0be37d8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:46.330559 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-b3772baf-f535-4083-a729-d680f0be37d8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:46.331743 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-b3772baf-f535-4083-a729-d680f0be37d8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1746 microversion: 2.20 time: 0.255488 Jan 24 09:23:46.332302 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 511/1016] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:23:46 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1746 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:23:46.434955 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-cf724a15-9d2a-46d8-aca0-4c1ced1f214b tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1575359668", "imageRef": "c527e37f-a381-465e-babe-11528029ed9b", "flavorRef": "452", "networks": [{"uuid": "c4cf2215-2834-4f58-92b9-07bf71222c87"}]}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:46.490221 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.network.neutron [None req-cf724a15-9d2a-46d8-aca0-4c1ced1f214b tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] validate_networks() for [('c4cf2215-2834-4f58-92b9-07bf71222c87', None, None, None, None, None)] {{(pid=116864) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 09:23:46.845840 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-cf724a15-9d2a-46d8-aca0-4c1ced1f214b tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Flavor limits 0:0:0 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 09:23:46.846483 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-cf724a15-9d2a-46d8-aca0-4c1ced1f214b tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Image limits 0:0:0 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 09:23:46.846744 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-cf724a15-9d2a-46d8-aca0-4c1ced1f214b tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Flavor pref 0:0:0 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 09:23:46.847148 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-cf724a15-9d2a-46d8-aca0-4c1ced1f214b tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Image pref 0:0:0 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 09:23:46.847553 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-cf724a15-9d2a-46d8-aca0-4c1ced1f214b tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 09:23:46.858645 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-cf724a15-9d2a-46d8-aca0-4c1ced1f214b tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:46.859094 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-cf724a15-9d2a-46d8-aca0-4c1ced1f214b tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:46.859939 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-cf724a15-9d2a-46d8-aca0-4c1ced1f214b tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:46.860396 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-cf724a15-9d2a-46d8-aca0-4c1ced1f214b tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:46.879234 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.quota [None req-cf724a15-9d2a-46d8-aca0-4c1ced1f214b tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Getting quotas for project 1c949bc4951b4373b064a77e47c3dc8d. Resources: {'ram', 'cores', 'instances'} {{(pid=116864) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 09:23:46.883684 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.quota [None req-cf724a15-9d2a-46d8-aca0-4c1ced1f214b tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Getting quotas for user b7dd4e5c6c9f467dab0d6b069d51b627 and project 1c949bc4951b4373b064a77e47c3dc8d. Resources: {'ram', 'cores', 'instances'} {{(pid=116864) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 09:23:46.891506 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-be752419-14d1-416f-8460-bf7550652886 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:46.892828 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-be752419-14d1-416f-8460-bf7550652886 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:46.895919 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-cf724a15-9d2a-46d8-aca0-4c1ced1f214b tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Going to run 1 instances... {{(pid=116864) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 09:23:46.898662 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-cf724a15-9d2a-46d8-aca0-4c1ced1f214b tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] [instance: 2d0785ce-c2d6-41e2-a529-ff266689e287] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c527e37f-a381-465e-babe-11528029ed9b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 09:23:46.899296 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-be752419-14d1-416f-8460-bf7550652886 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:46.899824 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-be752419-14d1-416f-8460-bf7550652886 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:46.900692 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-be752419-14d1-416f-8460-bf7550652886 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:46.901865 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-be752419-14d1-416f-8460-bf7550652886 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:46.982742 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-be752419-14d1-416f-8460-bf7550652886 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action" status: 200 len: 19133 microversion: 2.1 time: 0.094639 Jan 24 09:23:46.983306 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 512/1017] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:23:46 2022] POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action => generated 19133 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 09:23:47.060781 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-cf724a15-9d2a-46d8-aca0-4c1ced1f214b tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.630568 Jan 24 09:23:47.061483 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 506/1018] 10.222.0.113 () {60 vars in 1151 bytes} [Mon Jan 24 09:23:46 2022] POST /compute/v2.1/servers => generated 382 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 24 09:23:47.072784 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-9dde9784-9f0f-44cb-8605-590daff86788 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:47.074189 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-9dde9784-9f0f-44cb-8605-590daff86788 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] [instance: 2d0785ce-c2d6-41e2-a529-ff266689e287] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:47.131680 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-9dde9784-9f0f-44cb-8605-590daff86788 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7dd4e5c6c9f467dab0d6b069d51b627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c949bc4951b4373b064a77e47c3dc8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:47.138878 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-9dde9784-9f0f-44cb-8605-590daff86788 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] 10.222.0.113 "GET /compute/v2.1/servers/2d0785ce-c2d6-41e2-a529-ff266689e287" status: 200 len: 1223 microversion: 2.1 time: 0.070325 Jan 24 09:23:47.139453 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 513/1019] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:47 2022] GET /compute/v2.1/servers/2d0785ce-c2d6-41e2-a529-ff266689e287 => generated 1223 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:23:47.353907 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-50214732-b3af-44ba-a619-126a7d74eff0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:47.354703 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-50214732-b3af-44ba-a619-126a7d74eff0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:47.361894 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-50214732-b3af-44ba-a619-126a7d74eff0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:47.362466 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-50214732-b3af-44ba-a619-126a7d74eff0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:47.374820 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-50214732-b3af-44ba-a619-126a7d74eff0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:47.375468 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-50214732-b3af-44ba-a619-126a7d74eff0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:47.379659 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [req-b49ce0d1-e5ab-437a-9726-0e1571bbf313 req-c29e1227-d7d6-4dc9-8a40-7caaf2f30083 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f32748bf-320b-4cb5-9616-7c1d7260e260", "tag": "5759d870-5446-4073-a6bb-068adfd04ca4"}]} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:47.381394 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:23:47.381394 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: warnings.warn(msg) Jan 24 09:23:47.390335 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-b49ce0d1-e5ab-437a-9726-0e1571bbf313 req-c29e1227-d7d6-4dc9-8a40-7caaf2f30083 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:47.390775 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-b49ce0d1-e5ab-437a-9726-0e1571bbf313 req-c29e1227-d7d6-4dc9-8a40-7caaf2f30083 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:47.402490 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.compute.server_external_events [req-b49ce0d1-e5ab-437a-9726-0e1571bbf313 req-c29e1227-d7d6-4dc9-8a40-7caaf2f30083 service nova] Creating event network-changed:5759d870-5446-4073-a6bb-068adfd04ca4 for instance f32748bf-320b-4cb5-9616-7c1d7260e260 on hv-cinder-80403 Jan 24 09:23:47.407771 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [req-b49ce0d1-e5ab-437a-9726-0e1571bbf313 req-c29e1227-d7d6-4dc9-8a40-7caaf2f30083 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031884 Jan 24 09:23:47.411537 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 514/1020] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 09:23:47.536076 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-50214732-b3af-44ba-a619-126a7d74eff0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:47.550313 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-50214732-b3af-44ba-a619-126a7d74eff0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:47.552169 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-50214732-b3af-44ba-a619-126a7d74eff0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:47.553603 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-50214732-b3af-44ba-a619-126a7d74eff0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1746 microversion: 2.20 time: 0.204755 Jan 24 09:23:47.554187 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 507/1021] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:23:47 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1746 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:23:47.996365 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-911012be-a53a-4139-9898-8aa37db371ba tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:47.997518 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-911012be-a53a-4139-9898-8aa37db371ba tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:48.005431 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-911012be-a53a-4139-9898-8aa37db371ba tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:48.005879 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-911012be-a53a-4139-9898-8aa37db371ba tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:48.006962 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-911012be-a53a-4139-9898-8aa37db371ba tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:48.007408 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-911012be-a53a-4139-9898-8aa37db371ba tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:48.090236 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-911012be-a53a-4139-9898-8aa37db371ba tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action" status: 200 len: 20757 microversion: 2.1 time: 0.099249 Jan 24 09:23:48.090900 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 515/1022] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:23:47 2022] POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action => generated 20757 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 09:23:48.161789 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-0e06c239-c392-4bfd-8623-d8757341045c tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:48.167170 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-0e06c239-c392-4bfd-8623-d8757341045c tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] [instance: 2d0785ce-c2d6-41e2-a529-ff266689e287] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:48.222698 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-0e06c239-c392-4bfd-8623-d8757341045c tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7dd4e5c6c9f467dab0d6b069d51b627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c949bc4951b4373b064a77e47c3dc8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:48.231435 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-0e06c239-c392-4bfd-8623-d8757341045c tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] 10.222.0.113 "GET /compute/v2.1/servers/2d0785ce-c2d6-41e2-a529-ff266689e287" status: 200 len: 1223 microversion: 2.1 time: 0.073893 Jan 24 09:23:48.232252 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 508/1023] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:48 2022] GET /compute/v2.1/servers/2d0785ce-c2d6-41e2-a529-ff266689e287 => generated 1223 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:23:48.573143 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-423a6378-ca41-4bcd-bddd-df5d0b3c5cc8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:48.573843 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-423a6378-ca41-4bcd-bddd-df5d0b3c5cc8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:48.581196 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-423a6378-ca41-4bcd-bddd-df5d0b3c5cc8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:48.581639 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-423a6378-ca41-4bcd-bddd-df5d0b3c5cc8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:48.582502 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-423a6378-ca41-4bcd-bddd-df5d0b3c5cc8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:48.582934 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-423a6378-ca41-4bcd-bddd-df5d0b3c5cc8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:48.756781 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-423a6378-ca41-4bcd-bddd-df5d0b3c5cc8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:48.764697 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-423a6378-ca41-4bcd-bddd-df5d0b3c5cc8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:48.766222 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-423a6378-ca41-4bcd-bddd-df5d0b3c5cc8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:48.767381 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-423a6378-ca41-4bcd-bddd-df5d0b3c5cc8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1741 microversion: 2.20 time: 0.198469 Jan 24 09:23:48.767939 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 516/1024] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:23:48 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1741 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 09:23:49.100993 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-25f2d72a-9375-48b2-8733-d6aaa98c7786 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:49.102325 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-25f2d72a-9375-48b2-8733-d6aaa98c7786 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:49.110558 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-25f2d72a-9375-48b2-8733-d6aaa98c7786 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:49.111182 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-25f2d72a-9375-48b2-8733-d6aaa98c7786 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:49.112114 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-25f2d72a-9375-48b2-8733-d6aaa98c7786 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:49.112658 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-25f2d72a-9375-48b2-8733-d6aaa98c7786 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:49.248902 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-fb383b51-9dbc-4229-ac9d-95f94cb8c5de tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:49.249536 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-fb383b51-9dbc-4229-ac9d-95f94cb8c5de tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] [instance: 2d0785ce-c2d6-41e2-a529-ff266689e287] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:49.258597 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-fb383b51-9dbc-4229-ac9d-95f94cb8c5de tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:49.259044 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-fb383b51-9dbc-4229-ac9d-95f94cb8c5de tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:49.259825 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-fb383b51-9dbc-4229-ac9d-95f94cb8c5de tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:49.260253 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-fb383b51-9dbc-4229-ac9d-95f94cb8c5de tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:49.327708 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-fb383b51-9dbc-4229-ac9d-95f94cb8c5de tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7dd4e5c6c9f467dab0d6b069d51b627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c949bc4951b4373b064a77e47c3dc8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:49.337160 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-fb383b51-9dbc-4229-ac9d-95f94cb8c5de tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] 10.222.0.113 "GET /compute/v2.1/servers/2d0785ce-c2d6-41e2-a529-ff266689e287" status: 200 len: 1275 microversion: 2.1 time: 0.092091 Jan 24 09:23:49.337501 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-25f2d72a-9375-48b2-8733-d6aaa98c7786 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action" status: 200 len: 22897 microversion: 2.1 time: 0.240253 Jan 24 09:23:49.338180 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 509/1025] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:23:49 2022] POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action => generated 22897 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:23:49.341597 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 517/1026] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:49 2022] GET /compute/v2.1/servers/2d0785ce-c2d6-41e2-a529-ff266689e287 => generated 1275 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:23:49.790856 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-b1e087a9-4e49-4358-910d-ffb032c535fc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:49.793558 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-b1e087a9-4e49-4358-910d-ffb032c535fc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:49.801820 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b1e087a9-4e49-4358-910d-ffb032c535fc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:49.802540 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b1e087a9-4e49-4358-910d-ffb032c535fc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:49.806669 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b1e087a9-4e49-4358-910d-ffb032c535fc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:49.809247 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b1e087a9-4e49-4358-910d-ffb032c535fc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:50.003726 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-b1e087a9-4e49-4358-910d-ffb032c535fc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:50.016364 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-b1e087a9-4e49-4358-910d-ffb032c535fc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:50.032969 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-b1e087a9-4e49-4358-910d-ffb032c535fc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:50.035565 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-b1e087a9-4e49-4358-910d-ffb032c535fc tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1741 microversion: 2.20 time: 0.251667 Jan 24 09:23:50.037620 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 510/1027] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:23:49 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1741 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 09:23:50.349869 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-587dcdf8-bd05-4152-9138-308ce8eebc5a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:50.351597 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-587dcdf8-bd05-4152-9138-308ce8eebc5a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:50.363288 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-f2b56ad7-f296-4d4c-856d-533106f2cb5d tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:50.364544 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-f2b56ad7-f296-4d4c-856d-533106f2cb5d tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] [instance: 2d0785ce-c2d6-41e2-a529-ff266689e287] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:50.376138 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-587dcdf8-bd05-4152-9138-308ce8eebc5a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:50.384895 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f2b56ad7-f296-4d4c-856d-533106f2cb5d tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:50.386738 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-587dcdf8-bd05-4152-9138-308ce8eebc5a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:50.388540 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-587dcdf8-bd05-4152-9138-308ce8eebc5a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:50.389313 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f2b56ad7-f296-4d4c-856d-533106f2cb5d tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:50.390363 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f2b56ad7-f296-4d4c-856d-533106f2cb5d tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:50.391312 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-587dcdf8-bd05-4152-9138-308ce8eebc5a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:50.391936 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f2b56ad7-f296-4d4c-856d-533106f2cb5d tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:50.515686 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-587dcdf8-bd05-4152-9138-308ce8eebc5a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action" status: 200 len: 23804 microversion: 2.1 time: 0.168985 Jan 24 09:23:50.519510 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-f2b56ad7-f296-4d4c-856d-533106f2cb5d tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7dd4e5c6c9f467dab0d6b069d51b627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c949bc4951b4373b064a77e47c3dc8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:50.520199 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 518/1028] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:23:50 2022] POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action => generated 23804 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 09:23:50.532736 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-f2b56ad7-f296-4d4c-856d-533106f2cb5d tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] 10.222.0.113 "GET /compute/v2.1/servers/2d0785ce-c2d6-41e2-a529-ff266689e287" status: 200 len: 1281 microversion: 2.1 time: 0.174545 Jan 24 09:23:50.534257 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 511/1029] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:50 2022] GET /compute/v2.1/servers/2d0785ce-c2d6-41e2-a529-ff266689e287 => generated 1281 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:23:50.559785 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [req-30f5ba25-d5e9-44d0-9787-81b672c5becf req-03322037-aefa-41ba-9865-8094a639bf0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab1e93a3-324f-47fc-b6ef-173b16f4e6f9", "name": "network-vif-plugged", "status": "completed", "tag": "11759d98-c43e-497b-a68d-7ce168a0cd80"}]} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:50.562458 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:23:50.562458 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: warnings.warn(msg) Jan 24 09:23:50.573848 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-30f5ba25-d5e9-44d0-9787-81b672c5becf req-03322037-aefa-41ba-9865-8094a639bf0f service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:50.574590 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-30f5ba25-d5e9-44d0-9787-81b672c5becf req-03322037-aefa-41ba-9865-8094a639bf0f service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:50.587126 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.compute.server_external_events [req-30f5ba25-d5e9-44d0-9787-81b672c5becf req-03322037-aefa-41ba-9865-8094a639bf0f service nova] Creating event network-vif-plugged:11759d98-c43e-497b-a68d-7ce168a0cd80 for instance ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 on hv-cinder-80403 Jan 24 09:23:50.593434 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [req-30f5ba25-d5e9-44d0-9787-81b672c5becf req-03322037-aefa-41ba-9865-8094a639bf0f service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038448 Jan 24 09:23:50.594661 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 519/1030] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:23:51.057948 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-a1008b30-afbb-4305-b82b-1e5ca4fb15ef tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:51.058881 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-a1008b30-afbb-4305-b82b-1e5ca4fb15ef tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:51.065725 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a1008b30-afbb-4305-b82b-1e5ca4fb15ef tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:51.066282 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a1008b30-afbb-4305-b82b-1e5ca4fb15ef tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:51.067278 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a1008b30-afbb-4305-b82b-1e5ca4fb15ef tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:51.067870 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a1008b30-afbb-4305-b82b-1e5ca4fb15ef tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:51.236752 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-a1008b30-afbb-4305-b82b-1e5ca4fb15ef tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:51.252422 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-a1008b30-afbb-4305-b82b-1e5ca4fb15ef tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:51.254265 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-a1008b30-afbb-4305-b82b-1e5ca4fb15ef tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:51.255831 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-a1008b30-afbb-4305-b82b-1e5ca4fb15ef tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1741 microversion: 2.20 time: 0.202250 Jan 24 09:23:51.266322 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 512/1031] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:23:51 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1741 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:23:51.529924 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-91887d01-7fc6-4ba4-8a33-05330fec3624 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:51.531075 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-91887d01-7fc6-4ba4-8a33-05330fec3624 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:51.540834 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-91887d01-7fc6-4ba4-8a33-05330fec3624 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:51.543782 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-91887d01-7fc6-4ba4-8a33-05330fec3624 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:51.543782 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-91887d01-7fc6-4ba4-8a33-05330fec3624 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:51.543782 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-91887d01-7fc6-4ba4-8a33-05330fec3624 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:51.553716 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-520bfd0d-2a70-4528-ad76-6ddb6d8a426c tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:51.554350 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-520bfd0d-2a70-4528-ad76-6ddb6d8a426c tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] [instance: 2d0785ce-c2d6-41e2-a529-ff266689e287] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:51.561920 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-520bfd0d-2a70-4528-ad76-6ddb6d8a426c tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:51.562419 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-520bfd0d-2a70-4528-ad76-6ddb6d8a426c tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:51.563218 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-520bfd0d-2a70-4528-ad76-6ddb6d8a426c tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:51.563663 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-520bfd0d-2a70-4528-ad76-6ddb6d8a426c tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:51.646483 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-91887d01-7fc6-4ba4-8a33-05330fec3624 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action" status: 200 len: 25153 microversion: 2.1 time: 0.116900 Jan 24 09:23:51.647182 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 520/1032] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:23:51 2022] POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action => generated 25153 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:23:51.740261 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-520bfd0d-2a70-4528-ad76-6ddb6d8a426c tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7dd4e5c6c9f467dab0d6b069d51b627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c949bc4951b4373b064a77e47c3dc8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:51.748216 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-520bfd0d-2a70-4528-ad76-6ddb6d8a426c tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] 10.222.0.113 "GET /compute/v2.1/servers/2d0785ce-c2d6-41e2-a529-ff266689e287" status: 200 len: 1323 microversion: 2.1 time: 0.198081 Jan 24 09:23:51.748998 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 513/1033] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:51 2022] GET /compute/v2.1/servers/2d0785ce-c2d6-41e2-a529-ff266689e287 => generated 1323 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:23:52.213201 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [req-61711cf5-3e0d-41d6-826d-5083e9481e25 req-93ab3f1a-0f86-4b29-9e60-1f4268c10651 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d0785ce-c2d6-41e2-a529-ff266689e287", "tag": "af44ef74-9065-4c31-aa65-3262cf173e00"}]} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:52.215388 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:23:52.215388 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: warnings.warn(msg) Jan 24 09:23:52.223153 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-61711cf5-3e0d-41d6-826d-5083e9481e25 req-93ab3f1a-0f86-4b29-9e60-1f4268c10651 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:52.223597 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-61711cf5-3e0d-41d6-826d-5083e9481e25 req-93ab3f1a-0f86-4b29-9e60-1f4268c10651 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:52.241909 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.compute.server_external_events [req-61711cf5-3e0d-41d6-826d-5083e9481e25 req-93ab3f1a-0f86-4b29-9e60-1f4268c10651 service nova] Creating event network-changed:af44ef74-9065-4c31-aa65-3262cf173e00 for instance 2d0785ce-c2d6-41e2-a529-ff266689e287 on hv-cinder-80403 Jan 24 09:23:52.249450 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [req-61711cf5-3e0d-41d6-826d-5083e9481e25 req-93ab3f1a-0f86-4b29-9e60-1f4268c10651 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040328 Jan 24 09:23:52.250052 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 521/1034] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:23:52.277989 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-45995321-5b1e-4175-86db-d24fdc345929 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:52.278681 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-45995321-5b1e-4175-86db-d24fdc345929 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:52.284730 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-45995321-5b1e-4175-86db-d24fdc345929 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:52.285177 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-45995321-5b1e-4175-86db-d24fdc345929 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:52.285962 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-45995321-5b1e-4175-86db-d24fdc345929 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:52.286425 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-45995321-5b1e-4175-86db-d24fdc345929 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:52.472885 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-45995321-5b1e-4175-86db-d24fdc345929 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:52.488319 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-45995321-5b1e-4175-86db-d24fdc345929 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:52.490236 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-45995321-5b1e-4175-86db-d24fdc345929 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:52.491637 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-45995321-5b1e-4175-86db-d24fdc345929 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1741 microversion: 2.20 time: 0.218648 Jan 24 09:23:52.492371 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 514/1035] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:23:52 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1741 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:23:52.661294 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-9d3abc98-9410-4a35-9e73-3734714240fa tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:52.662951 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-9d3abc98-9410-4a35-9e73-3734714240fa tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:52.671142 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9d3abc98-9410-4a35-9e73-3734714240fa tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:52.671881 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9d3abc98-9410-4a35-9e73-3734714240fa tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:52.672825 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9d3abc98-9410-4a35-9e73-3734714240fa tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:52.673411 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9d3abc98-9410-4a35-9e73-3734714240fa tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:52.766424 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-8e467d6b-9b8e-4f13-b506-5e9d9104a7f0 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:52.767012 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-8e467d6b-9b8e-4f13-b506-5e9d9104a7f0 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] [instance: 2d0785ce-c2d6-41e2-a529-ff266689e287] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:52.774020 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-9d3abc98-9410-4a35-9e73-3734714240fa tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action" status: 200 len: 26317 microversion: 2.1 time: 0.116651 Jan 24 09:23:52.775474 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 522/1036] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:23:52 2022] POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action => generated 26317 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:23:52.791800 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-8e467d6b-9b8e-4f13-b506-5e9d9104a7f0 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:52.792897 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-8e467d6b-9b8e-4f13-b506-5e9d9104a7f0 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:52.793812 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-8e467d6b-9b8e-4f13-b506-5e9d9104a7f0 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:52.794484 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-8e467d6b-9b8e-4f13-b506-5e9d9104a7f0 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:52.957912 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-8e467d6b-9b8e-4f13-b506-5e9d9104a7f0 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7dd4e5c6c9f467dab0d6b069d51b627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c949bc4951b4373b064a77e47c3dc8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:52.966834 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-8e467d6b-9b8e-4f13-b506-5e9d9104a7f0 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] 10.222.0.113 "GET /compute/v2.1/servers/2d0785ce-c2d6-41e2-a529-ff266689e287" status: 200 len: 1323 microversion: 2.1 time: 0.204027 Jan 24 09:23:52.977656 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 515/1037] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:52 2022] GET /compute/v2.1/servers/2d0785ce-c2d6-41e2-a529-ff266689e287 => generated 1323 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:23:53.517006 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-75cc5657-90b4-4fe7-bdbe-95ccf283b7b3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:53.517901 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-75cc5657-90b4-4fe7-bdbe-95ccf283b7b3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:53.525131 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-75cc5657-90b4-4fe7-bdbe-95ccf283b7b3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:53.525687 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-75cc5657-90b4-4fe7-bdbe-95ccf283b7b3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:53.526753 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-75cc5657-90b4-4fe7-bdbe-95ccf283b7b3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:53.527392 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-75cc5657-90b4-4fe7-bdbe-95ccf283b7b3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:53.697271 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-75cc5657-90b4-4fe7-bdbe-95ccf283b7b3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:53.706452 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-75cc5657-90b4-4fe7-bdbe-95ccf283b7b3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:53.708491 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-75cc5657-90b4-4fe7-bdbe-95ccf283b7b3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:53.709969 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-75cc5657-90b4-4fe7-bdbe-95ccf283b7b3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1741 microversion: 2.20 time: 0.201285 Jan 24 09:23:53.721401 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 523/1038] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:23:53 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1741 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:23:53.787106 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-2b8d2df9-b6a1-48fb-b4e9-df0a7a4b7f2d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:53.788037 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-2b8d2df9-b6a1-48fb-b4e9-df0a7a4b7f2d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:53.796068 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2b8d2df9-b6a1-48fb-b4e9-df0a7a4b7f2d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:53.796514 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2b8d2df9-b6a1-48fb-b4e9-df0a7a4b7f2d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:53.797295 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2b8d2df9-b6a1-48fb-b4e9-df0a7a4b7f2d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:53.797728 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2b8d2df9-b6a1-48fb-b4e9-df0a7a4b7f2d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:53.909005 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-2b8d2df9-b6a1-48fb-b4e9-df0a7a4b7f2d tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action" status: 200 len: 27123 microversion: 2.1 time: 0.126011 Jan 24 09:23:53.909987 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 516/1039] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:23:53 2022] POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action => generated 27123 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:23:53.984824 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-2e8ad109-c887-4792-905d-658ea34afbe5 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:53.985472 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-2e8ad109-c887-4792-905d-658ea34afbe5 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] [instance: 2d0785ce-c2d6-41e2-a529-ff266689e287] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:53.992521 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-2e8ad109-c887-4792-905d-658ea34afbe5 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:53.993291 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-2e8ad109-c887-4792-905d-658ea34afbe5 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:53.994263 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-2e8ad109-c887-4792-905d-658ea34afbe5 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:53.995516 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-2e8ad109-c887-4792-905d-658ea34afbe5 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:54.151194 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-2e8ad109-c887-4792-905d-658ea34afbe5 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7dd4e5c6c9f467dab0d6b069d51b627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c949bc4951b4373b064a77e47c3dc8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:54.159190 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-2e8ad109-c887-4792-905d-658ea34afbe5 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] 10.222.0.113 "GET /compute/v2.1/servers/2d0785ce-c2d6-41e2-a529-ff266689e287" status: 200 len: 1323 microversion: 2.1 time: 0.178167 Jan 24 09:23:54.162263 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 524/1040] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:53 2022] GET /compute/v2.1/servers/2d0785ce-c2d6-41e2-a529-ff266689e287 => generated 1323 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:23:54.729994 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-f3f872a2-d896-4307-a52c-63ff01c48720 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:54.730744 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-f3f872a2-d896-4307-a52c-63ff01c48720 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:54.741094 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f3f872a2-d896-4307-a52c-63ff01c48720 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:54.741551 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f3f872a2-d896-4307-a52c-63ff01c48720 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:54.742382 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f3f872a2-d896-4307-a52c-63ff01c48720 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:54.743006 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f3f872a2-d896-4307-a52c-63ff01c48720 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:54.896660 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-f3f872a2-d896-4307-a52c-63ff01c48720 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:54.905425 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-f3f872a2-d896-4307-a52c-63ff01c48720 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:54.907494 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-f3f872a2-d896-4307-a52c-63ff01c48720 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:54.908527 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-f3f872a2-d896-4307-a52c-63ff01c48720 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1741 microversion: 2.20 time: 0.183095 Jan 24 09:23:54.908734 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 517/1041] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:23:54 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1741 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:23:54.925644 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-74ac8d96-cf6e-4a53-b993-5853a578871a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:54.926691 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-74ac8d96-cf6e-4a53-b993-5853a578871a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:54.933844 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-74ac8d96-cf6e-4a53-b993-5853a578871a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:54.934324 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-74ac8d96-cf6e-4a53-b993-5853a578871a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:54.935112 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-74ac8d96-cf6e-4a53-b993-5853a578871a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:54.935550 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-74ac8d96-cf6e-4a53-b993-5853a578871a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:55.034665 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-74ac8d96-cf6e-4a53-b993-5853a578871a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action" status: 200 len: 27587 microversion: 2.1 time: 0.112428 Jan 24 09:23:55.035313 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 525/1042] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:23:54 2022] POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action => generated 27587 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:23:55.177563 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-1568cdfa-ce44-4a28-be83-bc4519d00066 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:55.178071 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-1568cdfa-ce44-4a28-be83-bc4519d00066 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] [instance: 2d0785ce-c2d6-41e2-a529-ff266689e287] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:55.186040 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1568cdfa-ce44-4a28-be83-bc4519d00066 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:55.186594 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1568cdfa-ce44-4a28-be83-bc4519d00066 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:55.187484 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1568cdfa-ce44-4a28-be83-bc4519d00066 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:55.187921 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1568cdfa-ce44-4a28-be83-bc4519d00066 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:55.327578 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-1568cdfa-ce44-4a28-be83-bc4519d00066 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7dd4e5c6c9f467dab0d6b069d51b627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c949bc4951b4373b064a77e47c3dc8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:55.334967 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-1568cdfa-ce44-4a28-be83-bc4519d00066 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] 10.222.0.113 "GET /compute/v2.1/servers/2d0785ce-c2d6-41e2-a529-ff266689e287" status: 200 len: 1323 microversion: 2.1 time: 0.161791 Jan 24 09:23:55.335544 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 518/1043] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:55 2022] GET /compute/v2.1/servers/2d0785ce-c2d6-41e2-a529-ff266689e287 => generated 1323 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:23:55.935433 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-d8396004-fe62-4486-8122-409049cdd8de tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:55.937409 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-d8396004-fe62-4486-8122-409049cdd8de tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:55.949479 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d8396004-fe62-4486-8122-409049cdd8de tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:55.949934 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d8396004-fe62-4486-8122-409049cdd8de tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:55.950939 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d8396004-fe62-4486-8122-409049cdd8de tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:55.951385 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d8396004-fe62-4486-8122-409049cdd8de tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:56.047686 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-352280b1-fa34-4ccf-9053-22d1d52513db tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:56.048612 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-352280b1-fa34-4ccf-9053-22d1d52513db tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:56.061272 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-352280b1-fa34-4ccf-9053-22d1d52513db tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:56.061722 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-352280b1-fa34-4ccf-9053-22d1d52513db tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:56.062562 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-352280b1-fa34-4ccf-9053-22d1d52513db tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:56.063253 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-352280b1-fa34-4ccf-9053-22d1d52513db tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:56.114961 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-d8396004-fe62-4486-8122-409049cdd8de tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:56.125114 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-d8396004-fe62-4486-8122-409049cdd8de tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:56.126791 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-d8396004-fe62-4486-8122-409049cdd8de tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:56.128060 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-d8396004-fe62-4486-8122-409049cdd8de tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1741 microversion: 2.20 time: 0.202930 Jan 24 09:23:56.139320 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 526/1044] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:23:55 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1741 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 09:23:56.173933 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-352280b1-fa34-4ccf-9053-22d1d52513db tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action" status: 200 len: 28011 microversion: 2.1 time: 0.129705 Jan 24 09:23:56.174625 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 519/1045] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:23:56 2022] POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action => generated 28011 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 09:23:56.352533 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-abeb86d5-3efe-48d9-a0bc-d597bde64548 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:56.354015 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-abeb86d5-3efe-48d9-a0bc-d597bde64548 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] [instance: 2d0785ce-c2d6-41e2-a529-ff266689e287] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:56.361225 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-abeb86d5-3efe-48d9-a0bc-d597bde64548 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:56.361813 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-abeb86d5-3efe-48d9-a0bc-d597bde64548 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:56.362739 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-abeb86d5-3efe-48d9-a0bc-d597bde64548 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:56.363289 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-abeb86d5-3efe-48d9-a0bc-d597bde64548 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:56.575759 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-abeb86d5-3efe-48d9-a0bc-d597bde64548 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7dd4e5c6c9f467dab0d6b069d51b627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c949bc4951b4373b064a77e47c3dc8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:56.594571 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-abeb86d5-3efe-48d9-a0bc-d597bde64548 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] 10.222.0.113 "GET /compute/v2.1/servers/2d0785ce-c2d6-41e2-a529-ff266689e287" status: 200 len: 1323 microversion: 2.1 time: 0.245756 Jan 24 09:23:56.595534 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 527/1046] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:56 2022] GET /compute/v2.1/servers/2d0785ce-c2d6-41e2-a529-ff266689e287 => generated 1323 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:23:57.147999 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-83a79995-0b16-41bc-83ec-f6ffc7435ae8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:57.149593 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-83a79995-0b16-41bc-83ec-f6ffc7435ae8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:57.158345 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-83a79995-0b16-41bc-83ec-f6ffc7435ae8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:57.159319 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-83a79995-0b16-41bc-83ec-f6ffc7435ae8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:57.160286 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-83a79995-0b16-41bc-83ec-f6ffc7435ae8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:57.160878 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-83a79995-0b16-41bc-83ec-f6ffc7435ae8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:57.188328 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-9b12a218-be59-437b-8bdf-fe6c321c8cfd tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:57.190115 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-9b12a218-be59-437b-8bdf-fe6c321c8cfd tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:57.201874 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9b12a218-be59-437b-8bdf-fe6c321c8cfd tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:57.203126 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9b12a218-be59-437b-8bdf-fe6c321c8cfd tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:57.205783 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9b12a218-be59-437b-8bdf-fe6c321c8cfd tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:57.206512 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9b12a218-be59-437b-8bdf-fe6c321c8cfd tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:57.305084 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-9b12a218-be59-437b-8bdf-fe6c321c8cfd tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action" status: 200 len: 28193 microversion: 2.1 time: 0.120870 Jan 24 09:23:57.306512 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 528/1047] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:23:57 2022] POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action => generated 28193 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 09:23:57.320665 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-83a79995-0b16-41bc-83ec-f6ffc7435ae8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:57.329700 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-83a79995-0b16-41bc-83ec-f6ffc7435ae8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:57.331258 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-83a79995-0b16-41bc-83ec-f6ffc7435ae8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:57.332442 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-83a79995-0b16-41bc-83ec-f6ffc7435ae8 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1741 microversion: 2.20 time: 0.189228 Jan 24 09:23:57.333007 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 520/1048] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:23:57 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1741 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:23:57.613292 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-a73a69e8-efce-4813-a385-b0255c079cff tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:57.614091 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-a73a69e8-efce-4813-a385-b0255c079cff tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] [instance: 2d0785ce-c2d6-41e2-a529-ff266689e287] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:57.621239 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a73a69e8-efce-4813-a385-b0255c079cff tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:57.621785 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a73a69e8-efce-4813-a385-b0255c079cff tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:57.622684 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a73a69e8-efce-4813-a385-b0255c079cff tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:57.623187 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a73a69e8-efce-4813-a385-b0255c079cff tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:57.782820 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-a73a69e8-efce-4813-a385-b0255c079cff tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7dd4e5c6c9f467dab0d6b069d51b627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c949bc4951b4373b064a77e47c3dc8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:57.790594 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-a73a69e8-efce-4813-a385-b0255c079cff tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] 10.222.0.113 "GET /compute/v2.1/servers/2d0785ce-c2d6-41e2-a529-ff266689e287" status: 200 len: 1323 microversion: 2.1 time: 0.181676 Jan 24 09:23:57.793544 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 529/1049] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:57 2022] GET /compute/v2.1/servers/2d0785ce-c2d6-41e2-a529-ff266689e287 => generated 1323 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:23:58.317259 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-5dbb70ef-9ac0-4afc-99a6-30a297e1e6cb tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:58.318312 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-5dbb70ef-9ac0-4afc-99a6-30a297e1e6cb tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:58.327638 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5dbb70ef-9ac0-4afc-99a6-30a297e1e6cb tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:58.328072 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5dbb70ef-9ac0-4afc-99a6-30a297e1e6cb tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:58.328953 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5dbb70ef-9ac0-4afc-99a6-30a297e1e6cb tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:58.329410 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5dbb70ef-9ac0-4afc-99a6-30a297e1e6cb tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:58.356266 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-f6e2b352-7014-483e-8387-b162d8e5fab7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:58.357660 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-f6e2b352-7014-483e-8387-b162d8e5fab7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:58.364746 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f6e2b352-7014-483e-8387-b162d8e5fab7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:58.365205 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f6e2b352-7014-483e-8387-b162d8e5fab7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:58.366002 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f6e2b352-7014-483e-8387-b162d8e5fab7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:58.366471 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f6e2b352-7014-483e-8387-b162d8e5fab7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:58.403210 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-5dbb70ef-9ac0-4afc-99a6-30a297e1e6cb tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action" status: 200 len: 28193 microversion: 2.1 time: 0.089676 Jan 24 09:23:58.405630 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 521/1050] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:23:58 2022] POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action => generated 28193 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:23:58.600056 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-f6e2b352-7014-483e-8387-b162d8e5fab7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:58.600056 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-f6e2b352-7014-483e-8387-b162d8e5fab7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:58.601057 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-f6e2b352-7014-483e-8387-b162d8e5fab7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:58.601057 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-f6e2b352-7014-483e-8387-b162d8e5fab7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1741 microversion: 2.20 time: 0.181477 Jan 24 09:23:58.601057 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 530/1051] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:23:58 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1741 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:23:58.601696 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [req-ddba44ad-2394-4ce9-9db8-b8a90e35b84f req-a2fd1286-9ab1-461a-849d-543ab894753e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d0785ce-c2d6-41e2-a529-ff266689e287", "name": "network-vif-plugged", "status": "completed", "tag": "af44ef74-9065-4c31-aa65-3262cf173e00"}]} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:58.601696 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:23:58.601696 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: warnings.warn(msg) Jan 24 09:23:58.601696 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-ddba44ad-2394-4ce9-9db8-b8a90e35b84f req-a2fd1286-9ab1-461a-849d-543ab894753e service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:58.601696 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-ddba44ad-2394-4ce9-9db8-b8a90e35b84f req-a2fd1286-9ab1-461a-849d-543ab894753e service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:58.602052 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.compute.server_external_events [req-ddba44ad-2394-4ce9-9db8-b8a90e35b84f req-a2fd1286-9ab1-461a-849d-543ab894753e service nova] Creating event network-vif-plugged:af44ef74-9065-4c31-aa65-3262cf173e00 for instance 2d0785ce-c2d6-41e2-a529-ff266689e287 on hv-cinder-80403 Jan 24 09:23:58.603330 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [req-ddba44ad-2394-4ce9-9db8-b8a90e35b84f req-a2fd1286-9ab1-461a-849d-543ab894753e service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032357 Jan 24 09:23:58.604228 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 522/1052] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 09:23:58.813204 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-fb3d0376-89b5-4365-be2d-d020d7e70242 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:58.814115 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-fb3d0376-89b5-4365-be2d-d020d7e70242 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] [instance: 2d0785ce-c2d6-41e2-a529-ff266689e287] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:58.821117 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-fb3d0376-89b5-4365-be2d-d020d7e70242 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:58.821572 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-fb3d0376-89b5-4365-be2d-d020d7e70242 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:58.822946 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-fb3d0376-89b5-4365-be2d-d020d7e70242 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:58.823470 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-fb3d0376-89b5-4365-be2d-d020d7e70242 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:59.054771 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-fb3d0376-89b5-4365-be2d-d020d7e70242 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7dd4e5c6c9f467dab0d6b069d51b627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c949bc4951b4373b064a77e47c3dc8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:59.068593 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-fb3d0376-89b5-4365-be2d-d020d7e70242 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] 10.222.0.113 "GET /compute/v2.1/servers/2d0785ce-c2d6-41e2-a529-ff266689e287" status: 200 len: 1323 microversion: 2.1 time: 0.258084 Jan 24 09:23:59.068593 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 531/1053] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:23:58 2022] GET /compute/v2.1/servers/2d0785ce-c2d6-41e2-a529-ff266689e287 => generated 1323 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:23:59.438691 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-87428003-f1dc-4d84-91f0-8ffc4bed0fa8 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:23:59.438691 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-87428003-f1dc-4d84-91f0-8ffc4bed0fa8 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:59.438691 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-87428003-f1dc-4d84-91f0-8ffc4bed0fa8 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:59.438691 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-87428003-f1dc-4d84-91f0-8ffc4bed0fa8 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:59.439485 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-87428003-f1dc-4d84-91f0-8ffc4bed0fa8 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:59.439485 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-87428003-f1dc-4d84-91f0-8ffc4bed0fa8 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:59.524509 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-87428003-f1dc-4d84-91f0-8ffc4bed0fa8 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action" status: 200 len: 28483 microversion: 2.1 time: 0.109569 Jan 24 09:23:59.525185 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 523/1054] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:23:59 2022] POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action => generated 28483 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 09:23:59.616880 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-2d29de97-9dba-4b3d-b78d-d610c73c6298 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:23:59.617655 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-2d29de97-9dba-4b3d-b78d-d610c73c6298 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:23:59.625067 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-2d29de97-9dba-4b3d-b78d-d610c73c6298 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:59.625519 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-2d29de97-9dba-4b3d-b78d-d610c73c6298 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:59.626349 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-2d29de97-9dba-4b3d-b78d-d610c73c6298 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:23:59.626788 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-2d29de97-9dba-4b3d-b78d-d610c73c6298 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:23:59.766594 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-2d29de97-9dba-4b3d-b78d-d610c73c6298 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:59.774701 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-2d29de97-9dba-4b3d-b78d-d610c73c6298 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:59.776756 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-2d29de97-9dba-4b3d-b78d-d610c73c6298 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:23:59.777918 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-2d29de97-9dba-4b3d-b78d-d610c73c6298 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1741 microversion: 2.20 time: 0.164719 Jan 24 09:23:59.778505 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 532/1055] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:23:59 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1741 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:24:00.085822 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-cee7390d-ed89-4dfb-b567-815dc5ff1be4 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:24:00.086548 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-cee7390d-ed89-4dfb-b567-815dc5ff1be4 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] [instance: 2d0785ce-c2d6-41e2-a529-ff266689e287] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:00.094396 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-cee7390d-ed89-4dfb-b567-815dc5ff1be4 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:00.094849 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-cee7390d-ed89-4dfb-b567-815dc5ff1be4 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:00.095638 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-cee7390d-ed89-4dfb-b567-815dc5ff1be4 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:00.096137 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-cee7390d-ed89-4dfb-b567-815dc5ff1be4 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:00.250312 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-cee7390d-ed89-4dfb-b567-815dc5ff1be4 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7dd4e5c6c9f467dab0d6b069d51b627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c949bc4951b4373b064a77e47c3dc8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:00.258284 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-cee7390d-ed89-4dfb-b567-815dc5ff1be4 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] 10.222.0.113 "GET /compute/v2.1/servers/2d0785ce-c2d6-41e2-a529-ff266689e287" status: 200 len: 1323 microversion: 2.1 time: 0.176463 Jan 24 09:24:00.258858 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 524/1056] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:24:00 2022] GET /compute/v2.1/servers/2d0785ce-c2d6-41e2-a529-ff266689e287 => generated 1323 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:24:00.539861 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-8914f92c-cc64-44a8-b32e-b0de86f93694 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:24:00.541740 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-8914f92c-cc64-44a8-b32e-b0de86f93694 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:00.551313 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8914f92c-cc64-44a8-b32e-b0de86f93694 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:00.552129 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8914f92c-cc64-44a8-b32e-b0de86f93694 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:00.553572 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8914f92c-cc64-44a8-b32e-b0de86f93694 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:00.554417 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8914f92c-cc64-44a8-b32e-b0de86f93694 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:00.663516 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-8914f92c-cc64-44a8-b32e-b0de86f93694 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action" status: 200 len: 28651 microversion: 2.1 time: 0.129640 Jan 24 09:24:00.668733 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 533/1057] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:24:00 2022] POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action => generated 28651 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:24:00.801091 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-5a633091-2181-49f5-a100-b5160cac0f84 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:24:00.802272 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-5a633091-2181-49f5-a100-b5160cac0f84 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:00.809476 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5a633091-2181-49f5-a100-b5160cac0f84 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:00.809943 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5a633091-2181-49f5-a100-b5160cac0f84 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:00.810836 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5a633091-2181-49f5-a100-b5160cac0f84 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:00.811275 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5a633091-2181-49f5-a100-b5160cac0f84 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:00.947158 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-5a633091-2181-49f5-a100-b5160cac0f84 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:00.955820 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-5a633091-2181-49f5-a100-b5160cac0f84 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:00.957316 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-5a633091-2181-49f5-a100-b5160cac0f84 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:00.958512 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-5a633091-2181-49f5-a100-b5160cac0f84 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1723 microversion: 2.20 time: 0.164748 Jan 24 09:24:00.959072 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 525/1058] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:24:00 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:24:01.276501 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-566e1372-e5a1-4807-98fc-74d9967e36d4 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:24:01.277119 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-566e1372-e5a1-4807-98fc-74d9967e36d4 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] [instance: 2d0785ce-c2d6-41e2-a529-ff266689e287] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:01.284028 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-566e1372-e5a1-4807-98fc-74d9967e36d4 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:01.284450 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-566e1372-e5a1-4807-98fc-74d9967e36d4 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:01.285232 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-566e1372-e5a1-4807-98fc-74d9967e36d4 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:01.285711 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-566e1372-e5a1-4807-98fc-74d9967e36d4 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:01.425355 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-566e1372-e5a1-4807-98fc-74d9967e36d4 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7dd4e5c6c9f467dab0d6b069d51b627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c949bc4951b4373b064a77e47c3dc8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:01.433587 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-566e1372-e5a1-4807-98fc-74d9967e36d4 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] 10.222.0.113 "GET /compute/v2.1/servers/2d0785ce-c2d6-41e2-a529-ff266689e287" status: 200 len: 1512 microversion: 2.1 time: 0.161461 Jan 24 09:24:01.434180 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 534/1059] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:24:01 2022] GET /compute/v2.1/servers/2d0785ce-c2d6-41e2-a529-ff266689e287 => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:24:01.675541 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-0014767b-842f-4265-8a65-425bc307d265 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:24:01.676605 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-0014767b-842f-4265-8a65-425bc307d265 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:01.683754 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0014767b-842f-4265-8a65-425bc307d265 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:01.684231 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0014767b-842f-4265-8a65-425bc307d265 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:01.685108 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0014767b-842f-4265-8a65-425bc307d265 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:01.685499 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0014767b-842f-4265-8a65-425bc307d265 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:01.767531 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-0014767b-842f-4265-8a65-425bc307d265 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action" status: 200 len: 28651 microversion: 2.1 time: 0.095523 Jan 24 09:24:01.768185 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 526/1060] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:24:01 2022] POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action => generated 28651 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:24:01.976989 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-068386eb-b76a-46c4-af12-312a0a666c78 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:24:01.977606 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-068386eb-b76a-46c4-af12-312a0a666c78 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:01.984051 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-068386eb-b76a-46c4-af12-312a0a666c78 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:01.984494 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-068386eb-b76a-46c4-af12-312a0a666c78 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:01.985262 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-068386eb-b76a-46c4-af12-312a0a666c78 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:01.985693 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-068386eb-b76a-46c4-af12-312a0a666c78 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:02.123520 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-068386eb-b76a-46c4-af12-312a0a666c78 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:02.131527 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-068386eb-b76a-46c4-af12-312a0a666c78 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:02.133068 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-068386eb-b76a-46c4-af12-312a0a666c78 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:02.134241 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-068386eb-b76a-46c4-af12-312a0a666c78 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1723 microversion: 2.20 time: 0.160932 Jan 24 09:24:02.135496 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 535/1061] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:24:01 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:24:02.779310 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-1ba0d418-495a-4c28-8cb9-40d3ca701600 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:24:02.780354 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-1ba0d418-495a-4c28-8cb9-40d3ca701600 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:02.787473 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1ba0d418-495a-4c28-8cb9-40d3ca701600 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:02.787933 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1ba0d418-495a-4c28-8cb9-40d3ca701600 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:02.788734 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1ba0d418-495a-4c28-8cb9-40d3ca701600 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:02.789179 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1ba0d418-495a-4c28-8cb9-40d3ca701600 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:02.868327 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-1ba0d418-495a-4c28-8cb9-40d3ca701600 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action" status: 200 len: 28651 microversion: 2.1 time: 0.093079 Jan 24 09:24:02.869819 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 527/1062] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:24:02 2022] POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action => generated 28651 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:24:03.154482 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-84dbc5e6-f7d4-4407-a8fb-d558cafef1f0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:24:03.155092 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-84dbc5e6-f7d4-4407-a8fb-d558cafef1f0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:03.162291 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-84dbc5e6-f7d4-4407-a8fb-d558cafef1f0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:03.162784 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-84dbc5e6-f7d4-4407-a8fb-d558cafef1f0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:03.163511 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-84dbc5e6-f7d4-4407-a8fb-d558cafef1f0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:03.164032 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-84dbc5e6-f7d4-4407-a8fb-d558cafef1f0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:03.316838 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-84dbc5e6-f7d4-4407-a8fb-d558cafef1f0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:03.325563 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-84dbc5e6-f7d4-4407-a8fb-d558cafef1f0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:03.327092 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-84dbc5e6-f7d4-4407-a8fb-d558cafef1f0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:03.328264 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-84dbc5e6-f7d4-4407-a8fb-d558cafef1f0 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1723 microversion: 2.20 time: 0.179317 Jan 24 09:24:03.328830 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 536/1063] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:24:03 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:24:03.881351 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-3668c9ac-e000-4204-8770-e126ed6f854e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:24:03.883288 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-3668c9ac-e000-4204-8770-e126ed6f854e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:03.889825 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3668c9ac-e000-4204-8770-e126ed6f854e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:03.890840 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3668c9ac-e000-4204-8770-e126ed6f854e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:03.895457 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3668c9ac-e000-4204-8770-e126ed6f854e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:03.895457 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3668c9ac-e000-4204-8770-e126ed6f854e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:03.953907 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 24 09:24:03.953907 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: Mon Jan 24 09:24:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 24 09:24:03.973050 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-3668c9ac-e000-4204-8770-e126ed6f854e tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action" status: 200 len: 28651 microversion: 2.1 time: 0.095703 Jan 24 09:24:03.974182 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 528/1064] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:24:03 2022] POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action => generated 28651 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:24:04.338734 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [req-c52055ee-eee1-4415-81d5-0370758b3123 req-cf719350-de9b-4b1d-94fa-f813cff2efac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab1e93a3-324f-47fc-b6ef-173b16f4e6f9", "name": "network-vif-unplugged", "status": "completed", "tag": "11759d98-c43e-497b-a68d-7ce168a0cd80"}]} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:24:04.340327 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:24:04.340327 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: warnings.warn(msg) Jan 24 09:24:04.347274 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-a4ab2526-569d-4269-9fd2-82378ea1ba0f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:24:04.347767 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-c52055ee-eee1-4415-81d5-0370758b3123 req-cf719350-de9b-4b1d-94fa-f813cff2efac service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:04.348019 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-a4ab2526-569d-4269-9fd2-82378ea1ba0f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:04.348205 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-c52055ee-eee1-4415-81d5-0370758b3123 req-cf719350-de9b-4b1d-94fa-f813cff2efac service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:04.356639 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a4ab2526-569d-4269-9fd2-82378ea1ba0f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:04.361149 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a4ab2526-569d-4269-9fd2-82378ea1ba0f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:04.361149 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a4ab2526-569d-4269-9fd2-82378ea1ba0f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:04.361149 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a4ab2526-569d-4269-9fd2-82378ea1ba0f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:04.361840 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.compute.server_external_events [req-c52055ee-eee1-4415-81d5-0370758b3123 req-cf719350-de9b-4b1d-94fa-f813cff2efac service nova] Unable to find a host for instance ab1e93a3-324f-47fc-b6ef-173b16f4e6f9. Dropping event network-vif-unplugged {{(pid=116863) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 24 09:24:04.362957 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [req-c52055ee-eee1-4415-81d5-0370758b3123 req-cf719350-de9b-4b1d-94fa-f813cff2efac service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028812 Jan 24 09:24:04.363586 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 537/1065] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jan 24 09:24:04.501623 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-a4ab2526-569d-4269-9fd2-82378ea1ba0f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:04.510760 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-a4ab2526-569d-4269-9fd2-82378ea1ba0f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:04.512326 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-a4ab2526-569d-4269-9fd2-82378ea1ba0f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:04.513586 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-a4ab2526-569d-4269-9fd2-82378ea1ba0f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1666 microversion: 2.20 time: 0.170807 Jan 24 09:24:04.514183 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 529/1066] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:24:04 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1666 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:24:04.532405 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-593f75ba-2ea3-4bcb-9641-c9baf68d7bf5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fa024a90-e4e4-4fa6-b33a-92388864c80b"}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:24:04.533464 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-593f75ba-2ea3-4bcb-9641-c9baf68d7bf5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:04.539702 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-593f75ba-2ea3-4bcb-9641-c9baf68d7bf5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:04.540151 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-593f75ba-2ea3-4bcb-9641-c9baf68d7bf5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:04.541383 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-593f75ba-2ea3-4bcb-9641-c9baf68d7bf5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:04.541869 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-593f75ba-2ea3-4bcb-9641-c9baf68d7bf5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:04.986049 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-5440aab5-d577-4324-a98d-1e2de39e3586 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:24:04.987007 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-5440aab5-d577-4324-a98d-1e2de39e3586 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:04.993482 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5440aab5-d577-4324-a98d-1e2de39e3586 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:04.994479 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5440aab5-d577-4324-a98d-1e2de39e3586 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:04.995338 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5440aab5-d577-4324-a98d-1e2de39e3586 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:04.995892 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5440aab5-d577-4324-a98d-1e2de39e3586 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:05.064066 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-5440aab5-d577-4324-a98d-1e2de39e3586 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action" status: 200 len: 28651 microversion: 2.1 time: 0.081586 Jan 24 09:24:05.064973 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 530/1067] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:24:04 2022] POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action => generated 28651 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 09:24:05.590157 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-593f75ba-2ea3-4bcb-9641-c9baf68d7bf5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.061564 Jan 24 09:24:05.590957 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 538/1068] 10.222.0.113 () {62 vars in 1368 bytes} [Mon Jan 24 09:24:04 2022] POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/os-volume_attachments => generated 188 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:24:05.721751 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-a9ce04ca-7390-4150-851c-dd1764131dae tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:24:05.722428 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-a9ce04ca-7390-4150-851c-dd1764131dae tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:05.730537 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a9ce04ca-7390-4150-851c-dd1764131dae tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:05.730993 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a9ce04ca-7390-4150-851c-dd1764131dae tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:05.732132 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a9ce04ca-7390-4150-851c-dd1764131dae tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:05.732273 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a9ce04ca-7390-4150-851c-dd1764131dae tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:06.075753 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-e9edcd43-aafd-418b-8e27-26ae1ee2e82c tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:24:06.076850 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-e9edcd43-aafd-418b-8e27-26ae1ee2e82c tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:06.084042 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e9edcd43-aafd-418b-8e27-26ae1ee2e82c tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:06.084506 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e9edcd43-aafd-418b-8e27-26ae1ee2e82c tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:06.085310 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e9edcd43-aafd-418b-8e27-26ae1ee2e82c tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:06.085804 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e9edcd43-aafd-418b-8e27-26ae1ee2e82c tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:06.161230 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-e9edcd43-aafd-418b-8e27-26ae1ee2e82c tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action" status: 200 len: 28651 microversion: 2.1 time: 0.089244 Jan 24 09:24:06.161903 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 539/1069] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:24:06 2022] POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action => generated 28651 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 09:24:06.292955 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-a9ce04ca-7390-4150-851c-dd1764131dae tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "DELETE /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/os-volume_attachments/fa024a90-e4e4-4fa6-b33a-92388864c80b" status: 202 len: 0 microversion: 2.20 time: 0.575238 Jan 24 09:24:06.293796 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 531/1070] 10.222.0.113 () {60 vars in 1461 bytes} [Mon Jan 24 09:24:05 2022] DELETE /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/os-volume_attachments/fa024a90-e4e4-4fa6-b33a-92388864c80b => generated 0 bytes in 578 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 24 09:24:06.354527 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-ead78e49-c57a-4c04-b3e3-d9267326c1d7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:24:06.355385 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-ead78e49-c57a-4c04-b3e3-d9267326c1d7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:06.362419 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ead78e49-c57a-4c04-b3e3-d9267326c1d7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:06.362862 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ead78e49-c57a-4c04-b3e3-d9267326c1d7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:06.363662 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ead78e49-c57a-4c04-b3e3-d9267326c1d7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:06.364070 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ead78e49-c57a-4c04-b3e3-d9267326c1d7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:06.580932 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-ead78e49-c57a-4c04-b3e3-d9267326c1d7 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action" status: 202 len: 0 microversion: 2.20 time: 0.230420 Jan 24 09:24:06.581551 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 540/1071] 10.222.0.113 () {62 vars in 1323 bytes} [Mon Jan 24 09:24:06 2022] POST /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 24 09:24:06.594909 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-a8a1829e-1439-4645-a371-e62d535e851b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:24:06.594909 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-a8a1829e-1439-4645-a371-e62d535e851b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:06.603650 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a8a1829e-1439-4645-a371-e62d535e851b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:06.604224 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a8a1829e-1439-4645-a371-e62d535e851b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:06.605984 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a8a1829e-1439-4645-a371-e62d535e851b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:06.606474 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a8a1829e-1439-4645-a371-e62d535e851b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:06.753887 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-a8a1829e-1439-4645-a371-e62d535e851b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:06.762877 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-a8a1829e-1439-4645-a371-e62d535e851b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:06.764397 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-a8a1829e-1439-4645-a371-e62d535e851b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:06.765736 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-a8a1829e-1439-4645-a371-e62d535e851b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1674 microversion: 2.20 time: 0.179375 Jan 24 09:24:06.766382 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 532/1072] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:24:06 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1674 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 09:24:07.176501 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-42be73e9-51da-4bd3-85b2-32157fb73df6 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:24:07.177432 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-42be73e9-51da-4bd3-85b2-32157fb73df6 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:07.185396 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-42be73e9-51da-4bd3-85b2-32157fb73df6 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:07.185851 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-42be73e9-51da-4bd3-85b2-32157fb73df6 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:07.186685 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-42be73e9-51da-4bd3-85b2-32157fb73df6 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:07.187125 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-42be73e9-51da-4bd3-85b2-32157fb73df6 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:07.283054 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-42be73e9-51da-4bd3-85b2-32157fb73df6 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action" status: 200 len: 29711 microversion: 2.1 time: 0.110609 Jan 24 09:24:07.283957 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 541/1073] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:24:07 2022] POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action => generated 29711 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:24:07.785001 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-d94cde3c-2793-4ede-82d9-80931da37be1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:24:07.785547 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-d94cde3c-2793-4ede-82d9-80931da37be1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:07.792359 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d94cde3c-2793-4ede-82d9-80931da37be1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:07.792963 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d94cde3c-2793-4ede-82d9-80931da37be1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:07.793866 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d94cde3c-2793-4ede-82d9-80931da37be1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:07.794386 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d94cde3c-2793-4ede-82d9-80931da37be1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:07.950255 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-d94cde3c-2793-4ede-82d9-80931da37be1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:07.958447 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-d94cde3c-2793-4ede-82d9-80931da37be1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:07.960508 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-d94cde3c-2793-4ede-82d9-80931da37be1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:07.961753 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-d94cde3c-2793-4ede-82d9-80931da37be1 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1676 microversion: 2.20 time: 0.180635 Jan 24 09:24:07.962351 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 533/1074] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:24:07 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1676 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:24:08.296737 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-7cfe9195-8875-4467-ab2c-059f941ca7e4 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:24:08.298003 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-7cfe9195-8875-4467-ab2c-059f941ca7e4 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:08.305452 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7cfe9195-8875-4467-ab2c-059f941ca7e4 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:08.305905 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7cfe9195-8875-4467-ab2c-059f941ca7e4 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:08.306893 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7cfe9195-8875-4467-ab2c-059f941ca7e4 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:08.307336 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7cfe9195-8875-4467-ab2c-059f941ca7e4 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:08.408587 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-7cfe9195-8875-4467-ab2c-059f941ca7e4 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action" status: 200 len: 31093 microversion: 2.1 time: 0.116473 Jan 24 09:24:08.409284 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 542/1075] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:24:08 2022] POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action => generated 31093 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:24:08.981211 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-dd09d59c-d851-4728-8377-3919aa729d1f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:24:08.981841 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-dd09d59c-d851-4728-8377-3919aa729d1f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:08.988247 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-dd09d59c-d851-4728-8377-3919aa729d1f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:08.988692 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-dd09d59c-d851-4728-8377-3919aa729d1f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:08.989464 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-dd09d59c-d851-4728-8377-3919aa729d1f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:08.989892 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-dd09d59c-d851-4728-8377-3919aa729d1f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:09.123190 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-dd09d59c-d851-4728-8377-3919aa729d1f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:09.131095 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-dd09d59c-d851-4728-8377-3919aa729d1f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:09.132581 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-dd09d59c-d851-4728-8377-3919aa729d1f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:09.133727 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-dd09d59c-d851-4728-8377-3919aa729d1f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1732 microversion: 2.20 time: 0.157185 Jan 24 09:24:09.134309 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 534/1076] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:24:08 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:24:09.421405 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-2b1dbeaf-04cc-4589-a3ac-b66bceddea45 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:24:09.422432 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-2b1dbeaf-04cc-4589-a3ac-b66bceddea45 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:09.429477 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-2b1dbeaf-04cc-4589-a3ac-b66bceddea45 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:09.429921 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-2b1dbeaf-04cc-4589-a3ac-b66bceddea45 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:09.430790 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-2b1dbeaf-04cc-4589-a3ac-b66bceddea45 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:09.431666 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-2b1dbeaf-04cc-4589-a3ac-b66bceddea45 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:10.154527 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-7ff9c3f3-e635-401e-9c17-3da3f3f171c3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:24:10.155156 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-7ff9c3f3-e635-401e-9c17-3da3f3f171c3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:10.161731 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-7ff9c3f3-e635-401e-9c17-3da3f3f171c3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:10.162285 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-7ff9c3f3-e635-401e-9c17-3da3f3f171c3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:10.163087 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-7ff9c3f3-e635-401e-9c17-3da3f3f171c3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:10.163531 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-7ff9c3f3-e635-401e-9c17-3da3f3f171c3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:10.333166 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-7ff9c3f3-e635-401e-9c17-3da3f3f171c3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:10.341944 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-7ff9c3f3-e635-401e-9c17-3da3f3f171c3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:10.343532 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-7ff9c3f3-e635-401e-9c17-3da3f3f171c3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:10.344690 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-7ff9c3f3-e635-401e-9c17-3da3f3f171c3 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1732 microversion: 2.20 time: 0.195689 Jan 24 09:24:10.345251 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 535/1077] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:24:10 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1732 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 09:24:11.362577 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-16750664-7f55-4736-b32a-791e1b337a24 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:24:11.363338 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-16750664-7f55-4736-b32a-791e1b337a24 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:11.369385 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-16750664-7f55-4736-b32a-791e1b337a24 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:11.369823 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-16750664-7f55-4736-b32a-791e1b337a24 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:11.371312 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-16750664-7f55-4736-b32a-791e1b337a24 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:11.371775 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-16750664-7f55-4736-b32a-791e1b337a24 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:11.520533 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-16750664-7f55-4736-b32a-791e1b337a24 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:11.528604 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-16750664-7f55-4736-b32a-791e1b337a24 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:11.530121 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-16750664-7f55-4736-b32a-791e1b337a24 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:11.531264 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-16750664-7f55-4736-b32a-791e1b337a24 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1732 microversion: 2.20 time: 0.172412 Jan 24 09:24:11.531825 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 536/1078] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:24:11 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 09:24:12.554493 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-c468d693-c13d-4267-a3a3-36971066d1ce tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:24:12.555280 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-c468d693-c13d-4267-a3a3-36971066d1ce tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:12.562426 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c468d693-c13d-4267-a3a3-36971066d1ce tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:12.562858 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c468d693-c13d-4267-a3a3-36971066d1ce tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:12.563696 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c468d693-c13d-4267-a3a3-36971066d1ce tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:12.564144 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c468d693-c13d-4267-a3a3-36971066d1ce tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:12.744291 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-c468d693-c13d-4267-a3a3-36971066d1ce tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:12.752259 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-c468d693-c13d-4267-a3a3-36971066d1ce tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:12.753772 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-c468d693-c13d-4267-a3a3-36971066d1ce tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:12.755069 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-c468d693-c13d-4267-a3a3-36971066d1ce tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1732 microversion: 2.20 time: 0.204594 Jan 24 09:24:12.774999 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 537/1079] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:24:12 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1732 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:24:13.792679 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-45d1a969-91ba-4e55-9d22-60ed50781882 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:24:13.793413 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-45d1a969-91ba-4e55-9d22-60ed50781882 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:13.801148 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-45d1a969-91ba-4e55-9d22-60ed50781882 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:13.801529 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-45d1a969-91ba-4e55-9d22-60ed50781882 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:13.802567 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-45d1a969-91ba-4e55-9d22-60ed50781882 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:13.803103 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-45d1a969-91ba-4e55-9d22-60ed50781882 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:13.953573 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-45d1a969-91ba-4e55-9d22-60ed50781882 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:13.961841 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-45d1a969-91ba-4e55-9d22-60ed50781882 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:13.963435 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-45d1a969-91ba-4e55-9d22-60ed50781882 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:13.964550 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-45d1a969-91ba-4e55-9d22-60ed50781882 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1732 microversion: 2.20 time: 0.175932 Jan 24 09:24:13.965123 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 538/1080] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:24:13 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1732 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 09:24:15.060111 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-cf347bba-0fe4-4ce9-85bb-e54ad8d7ff52 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:24:15.060111 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-cf347bba-0fe4-4ce9-85bb-e54ad8d7ff52 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:15.060111 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-cf347bba-0fe4-4ce9-85bb-e54ad8d7ff52 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:15.060111 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-cf347bba-0fe4-4ce9-85bb-e54ad8d7ff52 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:15.061596 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-cf347bba-0fe4-4ce9-85bb-e54ad8d7ff52 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:15.061596 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-cf347bba-0fe4-4ce9-85bb-e54ad8d7ff52 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:15.143492 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-cf347bba-0fe4-4ce9-85bb-e54ad8d7ff52 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:15.157039 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-cf347bba-0fe4-4ce9-85bb-e54ad8d7ff52 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:15.159808 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-cf347bba-0fe4-4ce9-85bb-e54ad8d7ff52 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:15.161882 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-cf347bba-0fe4-4ce9-85bb-e54ad8d7ff52 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1732 microversion: 2.20 time: 0.182188 Jan 24 09:24:15.174662 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 539/1081] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:24:14 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1732 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:24:16.182278 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-42af4b0f-711f-49d8-a277-877845d8da20 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:24:16.183072 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-42af4b0f-711f-49d8-a277-877845d8da20 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:16.190621 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-42af4b0f-711f-49d8-a277-877845d8da20 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:16.191079 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-42af4b0f-711f-49d8-a277-877845d8da20 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:16.191884 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-42af4b0f-711f-49d8-a277-877845d8da20 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:16.192325 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-42af4b0f-711f-49d8-a277-877845d8da20 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:16.335579 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-42af4b0f-711f-49d8-a277-877845d8da20 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:16.345994 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-42af4b0f-711f-49d8-a277-877845d8da20 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:16.347764 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-42af4b0f-711f-49d8-a277-877845d8da20 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:16.348965 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-42af4b0f-711f-49d8-a277-877845d8da20 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1732 microversion: 2.20 time: 0.170497 Jan 24 09:24:16.349730 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 540/1082] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:24:16 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1732 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 09:24:17.368149 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-cb988667-d3a2-42fe-a7c1-01bcdfe290ad tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:24:17.368933 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-cb988667-d3a2-42fe-a7c1-01bcdfe290ad tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:17.375357 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-cb988667-d3a2-42fe-a7c1-01bcdfe290ad tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:17.375804 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-cb988667-d3a2-42fe-a7c1-01bcdfe290ad tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:17.376572 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-cb988667-d3a2-42fe-a7c1-01bcdfe290ad tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:17.377001 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-cb988667-d3a2-42fe-a7c1-01bcdfe290ad tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:17.516306 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-cb988667-d3a2-42fe-a7c1-01bcdfe290ad tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:17.524194 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-cb988667-d3a2-42fe-a7c1-01bcdfe290ad tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:17.525710 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-cb988667-d3a2-42fe-a7c1-01bcdfe290ad tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:17.526902 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-cb988667-d3a2-42fe-a7c1-01bcdfe290ad tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1732 microversion: 2.20 time: 0.162467 Jan 24 09:24:17.527463 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 541/1083] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:24:17 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 09:24:18.594187 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-222c9d93-3b68-489a-9587-20d2b3bfe76b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:24:18.594187 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-222c9d93-3b68-489a-9587-20d2b3bfe76b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:18.594187 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-222c9d93-3b68-489a-9587-20d2b3bfe76b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:18.594187 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-222c9d93-3b68-489a-9587-20d2b3bfe76b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:18.595244 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-222c9d93-3b68-489a-9587-20d2b3bfe76b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:18.595244 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-222c9d93-3b68-489a-9587-20d2b3bfe76b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:18.702876 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-222c9d93-3b68-489a-9587-20d2b3bfe76b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:18.711665 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-222c9d93-3b68-489a-9587-20d2b3bfe76b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:18.713250 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-222c9d93-3b68-489a-9587-20d2b3bfe76b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:18.714436 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-222c9d93-3b68-489a-9587-20d2b3bfe76b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1732 microversion: 2.20 time: 0.172918 Jan 24 09:24:18.714992 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 542/1084] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:24:18 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:24:19.736490 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-5e7f9b45-c751-4745-ae38-4f9852377d39 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:24:19.737199 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-5e7f9b45-c751-4745-ae38-4f9852377d39 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:19.743481 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5e7f9b45-c751-4745-ae38-4f9852377d39 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:19.744160 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5e7f9b45-c751-4745-ae38-4f9852377d39 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:19.744992 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5e7f9b45-c751-4745-ae38-4f9852377d39 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:19.745434 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5e7f9b45-c751-4745-ae38-4f9852377d39 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:19.891137 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-5e7f9b45-c751-4745-ae38-4f9852377d39 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:19.899745 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-5e7f9b45-c751-4745-ae38-4f9852377d39 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:19.901304 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-5e7f9b45-c751-4745-ae38-4f9852377d39 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:19.902594 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-5e7f9b45-c751-4745-ae38-4f9852377d39 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1732 microversion: 2.20 time: 0.173357 Jan 24 09:24:19.908684 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 543/1085] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:24:19 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1732 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 09:24:20.583298 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-2b1dbeaf-04cc-4589-a3ac-b66bceddea45 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action" status: 200 len: 38169 microversion: 2.1 time: 11.166098 Jan 24 09:24:20.584553 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 543/1086] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:24:09 2022] POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action => generated 38169 bytes in 11169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:24:20.921207 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-d40abd33-f954-4015-8560-c80025d5c294 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:24:20.923581 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-d40abd33-f954-4015-8560-c80025d5c294 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:20.928083 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d40abd33-f954-4015-8560-c80025d5c294 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:20.928531 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d40abd33-f954-4015-8560-c80025d5c294 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:20.929456 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d40abd33-f954-4015-8560-c80025d5c294 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:20.929899 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d40abd33-f954-4015-8560-c80025d5c294 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:21.062437 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-d40abd33-f954-4015-8560-c80025d5c294 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:21.070688 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-d40abd33-f954-4015-8560-c80025d5c294 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:21.072203 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-d40abd33-f954-4015-8560-c80025d5c294 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:21.073380 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-d40abd33-f954-4015-8560-c80025d5c294 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1732 microversion: 2.20 time: 0.156002 Jan 24 09:24:21.073919 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 544/1087] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:24:20 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:24:21.122054 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-5ac304f3-b9bb-4d1f-bf7e-a0f39b80ba31 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "34335511-bcfc-452e-989b-89c96337cd89", "device": "/dev/sdb"}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:24:21.124649 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-5ac304f3-b9bb-4d1f-bf7e-a0f39b80ba31 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] [instance: 2d0785ce-c2d6-41e2-a529-ff266689e287] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:21.132166 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5ac304f3-b9bb-4d1f-bf7e-a0f39b80ba31 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:21.132636 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5ac304f3-b9bb-4d1f-bf7e-a0f39b80ba31 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:21.133401 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5ac304f3-b9bb-4d1f-bf7e-a0f39b80ba31 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:21.133837 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5ac304f3-b9bb-4d1f-bf7e-a0f39b80ba31 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:21.597146 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-32328f02-d7f1-441c-8639-69c003923d0f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:24:21.598190 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-32328f02-d7f1-441c-8639-69c003923d0f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:21.607018 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-32328f02-d7f1-441c-8639-69c003923d0f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:21.607356 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-32328f02-d7f1-441c-8639-69c003923d0f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:21.608771 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-32328f02-d7f1-441c-8639-69c003923d0f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:21.609473 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-32328f02-d7f1-441c-8639-69c003923d0f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:21.703738 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-32328f02-d7f1-441c-8639-69c003923d0f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action" status: 200 len: 38187 microversion: 2.1 time: 0.112110 Jan 24 09:24:21.704648 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 545/1088] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:24:21 2022] POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action => generated 38187 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:24:21.895278 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-5ac304f3-b9bb-4d1f-bf7e-a0f39b80ba31 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] 10.222.0.113 "POST /compute/v2.1/servers/2d0785ce-c2d6-41e2-a529-ff266689e287/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.777190 Jan 24 09:24:21.895901 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 544/1089] 10.222.0.113 () {60 vars in 1327 bytes} [Mon Jan 24 09:24:21 2022] POST /compute/v2.1/servers/2d0785ce-c2d6-41e2-a529-ff266689e287/os-volume_attachments => generated 194 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:24:22.091579 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-2d4f6c74-8a11-4b2e-b826-78fd4f16e18a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:24:22.093039 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-2d4f6c74-8a11-4b2e-b826-78fd4f16e18a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:22.100603 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2d4f6c74-8a11-4b2e-b826-78fd4f16e18a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:22.101061 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2d4f6c74-8a11-4b2e-b826-78fd4f16e18a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:22.101891 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2d4f6c74-8a11-4b2e-b826-78fd4f16e18a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:22.102489 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2d4f6c74-8a11-4b2e-b826-78fd4f16e18a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:22.243445 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-2d4f6c74-8a11-4b2e-b826-78fd4f16e18a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:22.251747 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-2d4f6c74-8a11-4b2e-b826-78fd4f16e18a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:22.253214 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-2d4f6c74-8a11-4b2e-b826-78fd4f16e18a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:22.254443 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-2d4f6c74-8a11-4b2e-b826-78fd4f16e18a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1732 microversion: 2.20 time: 0.166915 Jan 24 09:24:22.255102 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 546/1090] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:24:22 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:24:22.717089 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-f6c9b2db-bba3-433d-959b-47fa77df91f3 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:24:22.718410 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-f6c9b2db-bba3-433d-959b-47fa77df91f3 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:22.726347 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f6c9b2db-bba3-433d-959b-47fa77df91f3 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:22.726886 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f6c9b2db-bba3-433d-959b-47fa77df91f3 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:22.727682 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f6c9b2db-bba3-433d-959b-47fa77df91f3 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:22.728312 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f6c9b2db-bba3-433d-959b-47fa77df91f3 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:22.841048 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-f6c9b2db-bba3-433d-959b-47fa77df91f3 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action" status: 200 len: 38300 microversion: 2.1 time: 0.128031 Jan 24 09:24:22.843276 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 545/1091] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:24:22 2022] POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/action => generated 38300 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 09:24:22.852818 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-8c1233f5-663f-419b-9c7a-d3a6ded69feb tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:24:22.853318 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-8c1233f5-663f-419b-9c7a-d3a6ded69feb tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:22.859736 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-8c1233f5-663f-419b-9c7a-d3a6ded69feb tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:22.860184 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-8c1233f5-663f-419b-9c7a-d3a6ded69feb tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:22.860971 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-8c1233f5-663f-419b-9c7a-d3a6ded69feb tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:22.861411 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-8c1233f5-663f-419b-9c7a-d3a6ded69feb tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:22.886245 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-8c1233f5-663f-419b-9c7a-d3a6ded69feb tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/ips" status: 200 len: 146 microversion: 2.1 time: 0.036996 Jan 24 09:24:22.886836 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 547/1092] 10.222.0.113 () {58 vars in 1252 bytes} [Mon Jan 24 09:24:22 2022] GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:24:23.272891 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-1e72004f-d022-4687-94b9-9a72aa273462 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:24:23.273590 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-1e72004f-d022-4687-94b9-9a72aa273462 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:23.281193 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1e72004f-d022-4687-94b9-9a72aa273462 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:23.281648 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1e72004f-d022-4687-94b9-9a72aa273462 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:23.282463 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1e72004f-d022-4687-94b9-9a72aa273462 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:23.282947 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1e72004f-d022-4687-94b9-9a72aa273462 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:23.426848 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-1e72004f-d022-4687-94b9-9a72aa273462 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:23.439546 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-1e72004f-d022-4687-94b9-9a72aa273462 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:23.439546 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-1e72004f-d022-4687-94b9-9a72aa273462 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:23.439546 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-1e72004f-d022-4687-94b9-9a72aa273462 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1732 microversion: 2.20 time: 0.169432 Jan 24 09:24:23.439952 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 546/1093] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:24:23 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:24:24.456713 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-dbe04652-60a3-4596-a4b2-7a1b64f87208 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:24:24.457194 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-dbe04652-60a3-4596-a4b2-7a1b64f87208 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:24.464049 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-dbe04652-60a3-4596-a4b2-7a1b64f87208 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:24.464504 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-dbe04652-60a3-4596-a4b2-7a1b64f87208 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:24.465299 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-dbe04652-60a3-4596-a4b2-7a1b64f87208 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:24.465740 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-dbe04652-60a3-4596-a4b2-7a1b64f87208 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:24.504914 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-e5eb3173-44b1-43bc-b9ad-829b2b7f487b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fcd95237-2ea8-47f8-854e-8d96decaeb23"}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:24:24.505982 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-e5eb3173-44b1-43bc-b9ad-829b2b7f487b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:24.512579 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e5eb3173-44b1-43bc-b9ad-829b2b7f487b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:24.513202 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e5eb3173-44b1-43bc-b9ad-829b2b7f487b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:24.514174 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e5eb3173-44b1-43bc-b9ad-829b2b7f487b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:24.514719 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e5eb3173-44b1-43bc-b9ad-829b2b7f487b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:24.617636 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-dbe04652-60a3-4596-a4b2-7a1b64f87208 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:24.626563 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-dbe04652-60a3-4596-a4b2-7a1b64f87208 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:24.628404 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-dbe04652-60a3-4596-a4b2-7a1b64f87208 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:24.629586 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-dbe04652-60a3-4596-a4b2-7a1b64f87208 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1732 microversion: 2.20 time: 0.176855 Jan 24 09:24:24.630180 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 548/1094] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:24:24 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1732 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:24:24.635793 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [req-61ae7008-78ca-434b-b8d1-8d9cbc754398 req-cd2dfa2c-c96f-4ef3-9cce-f0740f848c6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab1e93a3-324f-47fc-b6ef-173b16f4e6f9", "name": "network-vif-plugged", "status": "completed", "tag": "11759d98-c43e-497b-a68d-7ce168a0cd80"}]} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:24:24.636199 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:24:24.636199 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: warnings.warn(msg) Jan 24 09:24:24.643964 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-61ae7008-78ca-434b-b8d1-8d9cbc754398 req-cd2dfa2c-c96f-4ef3-9cce-f0740f848c6f service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:24.644409 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-61ae7008-78ca-434b-b8d1-8d9cbc754398 req-cd2dfa2c-c96f-4ef3-9cce-f0740f848c6f service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:24.655686 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.compute.server_external_events [req-61ae7008-78ca-434b-b8d1-8d9cbc754398 req-cd2dfa2c-c96f-4ef3-9cce-f0740f848c6f service nova] Creating event network-vif-plugged:11759d98-c43e-497b-a68d-7ce168a0cd80 for instance ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 on hv-cinder-80403 Jan 24 09:24:24.661159 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [req-61ae7008-78ca-434b-b8d1-8d9cbc754398 req-cd2dfa2c-c96f-4ef3-9cce-f0740f848c6f service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029762 Jan 24 09:24:24.664527 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 549/1095] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:24:25.169758 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-e5eb3173-44b1-43bc-b9ad-829b2b7f487b tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.668418 Jan 24 09:24:25.170435 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 547/1096] 10.222.0.113 () {60 vars in 1327 bytes} [Mon Jan 24 09:24:24 2022] POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/os-volume_attachments => generated 194 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:24:25.649311 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-ec31b0c6-ca22-4ce8-8347-a534bb6ed48b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:24:25.649913 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-ec31b0c6-ca22-4ce8-8347-a534bb6ed48b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:25.657108 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ec31b0c6-ca22-4ce8-8347-a534bb6ed48b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:25.657549 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ec31b0c6-ca22-4ce8-8347-a534bb6ed48b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:25.658354 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ec31b0c6-ca22-4ce8-8347-a534bb6ed48b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:25.658785 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ec31b0c6-ca22-4ce8-8347-a534bb6ed48b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:25.804607 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-ec31b0c6-ca22-4ce8-8347-a534bb6ed48b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:25.813007 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-ec31b0c6-ca22-4ce8-8347-a534bb6ed48b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:25.814544 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-ec31b0c6-ca22-4ce8-8347-a534bb6ed48b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:25.815742 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-ec31b0c6-ca22-4ce8-8347-a534bb6ed48b tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1732 microversion: 2.20 time: 0.171257 Jan 24 09:24:25.816311 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 550/1097] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:24:25 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:24:26.834732 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-75426a69-2009-4aa5-86a7-b8429724f03f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:24:26.838866 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-75426a69-2009-4aa5-86a7-b8429724f03f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:26.841536 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-75426a69-2009-4aa5-86a7-b8429724f03f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:26.841978 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-75426a69-2009-4aa5-86a7-b8429724f03f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:26.842782 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-75426a69-2009-4aa5-86a7-b8429724f03f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:26.843262 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-75426a69-2009-4aa5-86a7-b8429724f03f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:26.980402 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-75426a69-2009-4aa5-86a7-b8429724f03f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:26.989208 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-75426a69-2009-4aa5-86a7-b8429724f03f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:26.990443 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-75426a69-2009-4aa5-86a7-b8429724f03f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:26.991640 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-75426a69-2009-4aa5-86a7-b8429724f03f tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1732 microversion: 2.20 time: 0.161469 Jan 24 09:24:26.992208 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 548/1098] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:24:26 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:24:28.009119 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-b8736fb0-664f-4e3c-8e63-e2e2c398996a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:24:28.009700 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-b8736fb0-664f-4e3c-8e63-e2e2c398996a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:28.016812 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b8736fb0-664f-4e3c-8e63-e2e2c398996a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:28.017254 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b8736fb0-664f-4e3c-8e63-e2e2c398996a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:28.018024 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b8736fb0-664f-4e3c-8e63-e2e2c398996a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:28.018494 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b8736fb0-664f-4e3c-8e63-e2e2c398996a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:28.156794 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-b8736fb0-664f-4e3c-8e63-e2e2c398996a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:28.165294 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-b8736fb0-664f-4e3c-8e63-e2e2c398996a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:28.166900 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-b8736fb0-664f-4e3c-8e63-e2e2c398996a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:28.168121 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-b8736fb0-664f-4e3c-8e63-e2e2c398996a tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1719 microversion: 2.20 time: 0.162736 Jan 24 09:24:28.168684 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 551/1099] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:24:28 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:24:39.301530 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-b815b02d-c31d-493f-8466-813d9a00c4cd tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:24:39.302542 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-b815b02d-c31d-493f-8466-813d9a00c4cd tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:39.308819 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b815b02d-c31d-493f-8466-813d9a00c4cd tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:39.309272 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b815b02d-c31d-493f-8466-813d9a00c4cd tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:39.310055 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b815b02d-c31d-493f-8466-813d9a00c4cd tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:39.311265 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b815b02d-c31d-493f-8466-813d9a00c4cd tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:39.340668 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-b815b02d-c31d-493f-8466-813d9a00c4cd tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042798 Jan 24 09:24:39.341234 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 549/1100] 10.222.0.113 () {58 vars in 1306 bytes} [Mon Jan 24 09:24:39 2022] GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:24:39.350770 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-c701a80b-f233-4036-98ed-3e10e1834e73 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:24:39.351253 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-c701a80b-f233-4036-98ed-3e10e1834e73 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:39.357466 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c701a80b-f233-4036-98ed-3e10e1834e73 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:39.357908 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c701a80b-f233-4036-98ed-3e10e1834e73 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:39.358714 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c701a80b-f233-4036-98ed-3e10e1834e73 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:39.359150 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c701a80b-f233-4036-98ed-3e10e1834e73 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:39.387232 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-c701a80b-f233-4036-98ed-3e10e1834e73 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/os-volume_attachments/fcd95237-2ea8-47f8-854e-8d96decaeb23" status: 200 len: 194 microversion: 2.1 time: 0.040164 Jan 24 09:24:39.387806 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 552/1101] 10.222.0.113 () {58 vars in 1417 bytes} [Mon Jan 24 09:24:39 2022] GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/os-volume_attachments/fcd95237-2ea8-47f8-854e-8d96decaeb23 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:24:43.062277 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-d4be3861-d310-4417-9d49-ae87ac247738 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5ce66a2b-0eb2-46ca-9cb7-543d4d3b7cd7"}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:24:43.063430 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-d4be3861-d310-4417-9d49-ae87ac247738 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:43.069624 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d4be3861-d310-4417-9d49-ae87ac247738 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:43.070075 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d4be3861-d310-4417-9d49-ae87ac247738 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:43.070875 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d4be3861-d310-4417-9d49-ae87ac247738 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:43.071304 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d4be3861-d310-4417-9d49-ae87ac247738 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:43.774945 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-d4be3861-d310-4417-9d49-ae87ac247738 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.716758 Jan 24 09:24:43.775579 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 550/1102] 10.222.0.113 () {60 vars in 1327 bytes} [Mon Jan 24 09:24:43 2022] POST /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/os-volume_attachments => generated 194 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:24:46.391946 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-e8eae487-1f28-4ab6-8eb4-4ee9b46273bb tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:24:46.392479 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-e8eae487-1f28-4ab6-8eb4-4ee9b46273bb tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] [instance: 2d0785ce-c2d6-41e2-a529-ff266689e287] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:46.398909 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e8eae487-1f28-4ab6-8eb4-4ee9b46273bb tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:46.402056 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e8eae487-1f28-4ab6-8eb4-4ee9b46273bb tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:46.402056 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e8eae487-1f28-4ab6-8eb4-4ee9b46273bb tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:46.402056 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e8eae487-1f28-4ab6-8eb4-4ee9b46273bb tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:46.484421 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.objects.instance [None req-e8eae487-1f28-4ab6-8eb4-4ee9b46273bb tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lazy-loading 'services' on Instance uuid 2d0785ce-c2d6-41e2-a529-ff266689e287 {{(pid=116864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 09:24:46.726437 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-e8eae487-1f28-4ab6-8eb4-4ee9b46273bb tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] 10.222.0.113 "DELETE /compute/v2.1/servers/2d0785ce-c2d6-41e2-a529-ff266689e287/os-volume_attachments/34335511-bcfc-452e-989b-89c96337cd89" status: 202 len: 0 microversion: 2.1 time: 0.337823 Jan 24 09:24:46.727017 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 553/1103] 10.222.0.113 () {58 vars in 1420 bytes} [Mon Jan 24 09:24:46 2022] DELETE /compute/v2.1/servers/2d0785ce-c2d6-41e2-a529-ff266689e287/os-volume_attachments/34335511-bcfc-452e-989b-89c96337cd89 => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:24:52.296005 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-c6ef1c9b-83ed-4418-b6cd-02ed51bdcb1a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:24:52.297024 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-c6ef1c9b-83ed-4418-b6cd-02ed51bdcb1a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:52.305909 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c6ef1c9b-83ed-4418-b6cd-02ed51bdcb1a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:52.307004 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c6ef1c9b-83ed-4418-b6cd-02ed51bdcb1a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:52.307498 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c6ef1c9b-83ed-4418-b6cd-02ed51bdcb1a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:52.308710 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c6ef1c9b-83ed-4418-b6cd-02ed51bdcb1a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:52.341102 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-c6ef1c9b-83ed-4418-b6cd-02ed51bdcb1a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050463 Jan 24 09:24:52.347822 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 551/1104] 10.222.0.113 () {58 vars in 1306 bytes} [Mon Jan 24 09:24:52 2022] GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/os-volume_attachments => generated 371 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:24:52.625560 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-3002e283-5489-45b1-a13c-c409a3ef8b36 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:24:52.626215 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-3002e283-5489-45b1-a13c-c409a3ef8b36 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:52.632285 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3002e283-5489-45b1-a13c-c409a3ef8b36 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:52.632728 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3002e283-5489-45b1-a13c-c409a3ef8b36 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:52.633494 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3002e283-5489-45b1-a13c-c409a3ef8b36 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:52.633926 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3002e283-5489-45b1-a13c-c409a3ef8b36 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:52.664358 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-3002e283-5489-45b1-a13c-c409a3ef8b36 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/os-volume_attachments/fcd95237-2ea8-47f8-854e-8d96decaeb23" status: 200 len: 194 microversion: 2.1 time: 0.043203 Jan 24 09:24:52.664940 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 554/1105] 10.222.0.113 () {58 vars in 1417 bytes} [Mon Jan 24 09:24:52 2022] GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/os-volume_attachments/fcd95237-2ea8-47f8-854e-8d96decaeb23 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 09:24:52.674703 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-a57d8131-74ca-46ef-ba58-4d6af2a196ca tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:24:52.675201 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-a57d8131-74ca-46ef-ba58-4d6af2a196ca tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:52.681124 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a57d8131-74ca-46ef-ba58-4d6af2a196ca tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:52.681567 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a57d8131-74ca-46ef-ba58-4d6af2a196ca tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:52.682381 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a57d8131-74ca-46ef-ba58-4d6af2a196ca tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:52.682817 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a57d8131-74ca-46ef-ba58-4d6af2a196ca tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:52.763880 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.objects.instance [None req-a57d8131-74ca-46ef-ba58-4d6af2a196ca tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lazy-loading 'services' on Instance uuid f3b808fd-b585-4062-a321-9965f704ffe6 {{(pid=116863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 09:24:52.920317 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-a57d8131-74ca-46ef-ba58-4d6af2a196ca tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "DELETE /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/os-volume_attachments/fcd95237-2ea8-47f8-854e-8d96decaeb23" status: 202 len: 0 microversion: 2.1 time: 0.248517 Jan 24 09:24:52.921083 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 552/1106] 10.222.0.113 () {58 vars in 1420 bytes} [Mon Jan 24 09:24:52 2022] DELETE /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/os-volume_attachments/fcd95237-2ea8-47f8-854e-8d96decaeb23 => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:24:53.111866 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-16a0a6d1-f370-4f23-add0-54df86ba8d50 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:24:53.112363 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-16a0a6d1-f370-4f23-add0-54df86ba8d50 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] [instance: 2d0785ce-c2d6-41e2-a529-ff266689e287] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:53.118294 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-16a0a6d1-f370-4f23-add0-54df86ba8d50 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:53.118748 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-16a0a6d1-f370-4f23-add0-54df86ba8d50 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:53.119529 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-16a0a6d1-f370-4f23-add0-54df86ba8d50 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:53.119970 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-16a0a6d1-f370-4f23-add0-54df86ba8d50 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:53.146291 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-16a0a6d1-f370-4f23-add0-54df86ba8d50 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] [instance: 2d0785ce-c2d6-41e2-a529-ff266689e287] Going to try to terminate instance {{(pid=116864) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 09:24:53.439602 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-16a0a6d1-f370-4f23-add0-54df86ba8d50 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] 10.222.0.113 "DELETE /compute/v2.1/servers/2d0785ce-c2d6-41e2-a529-ff266689e287" status: 204 len: 0 microversion: 2.1 time: 0.332257 Jan 24 09:24:53.440423 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 555/1107] 10.222.0.113 () {58 vars in 1243 bytes} [Mon Jan 24 09:24:53 2022] DELETE /compute/v2.1/servers/2d0785ce-c2d6-41e2-a529-ff266689e287 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 24 09:24:53.448741 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-349c0de4-c24f-4076-98ff-0bd252bf4321 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:24:53.454717 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-349c0de4-c24f-4076-98ff-0bd252bf4321 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] [instance: 2d0785ce-c2d6-41e2-a529-ff266689e287] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:53.456541 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-349c0de4-c24f-4076-98ff-0bd252bf4321 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:53.457081 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-349c0de4-c24f-4076-98ff-0bd252bf4321 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:53.457876 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-349c0de4-c24f-4076-98ff-0bd252bf4321 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:53.458355 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-349c0de4-c24f-4076-98ff-0bd252bf4321 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:53.844403 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-349c0de4-c24f-4076-98ff-0bd252bf4321 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7dd4e5c6c9f467dab0d6b069d51b627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c949bc4951b4373b064a77e47c3dc8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:53.851762 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-349c0de4-c24f-4076-98ff-0bd252bf4321 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] 10.222.0.113 "GET /compute/v2.1/servers/2d0785ce-c2d6-41e2-a529-ff266689e287" status: 200 len: 1518 microversion: 2.1 time: 0.407099 Jan 24 09:24:53.852333 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 553/1108] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:24:53 2022] GET /compute/v2.1/servers/2d0785ce-c2d6-41e2-a529-ff266689e287 => generated 1518 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:24:54.870382 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-a0e8c4d6-9d6f-4533-9c37-b1b3072b1b3a tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:24:54.871079 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-a0e8c4d6-9d6f-4533-9c37-b1b3072b1b3a tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] [instance: 2d0785ce-c2d6-41e2-a529-ff266689e287] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:54.878130 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a0e8c4d6-9d6f-4533-9c37-b1b3072b1b3a tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:54.878586 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a0e8c4d6-9d6f-4533-9c37-b1b3072b1b3a tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:54.879395 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a0e8c4d6-9d6f-4533-9c37-b1b3072b1b3a tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:54.879828 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a0e8c4d6-9d6f-4533-9c37-b1b3072b1b3a tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:55.012989 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-a0e8c4d6-9d6f-4533-9c37-b1b3072b1b3a tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7dd4e5c6c9f467dab0d6b069d51b627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c949bc4951b4373b064a77e47c3dc8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:55.021288 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-a0e8c4d6-9d6f-4533-9c37-b1b3072b1b3a tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] 10.222.0.113 "GET /compute/v2.1/servers/2d0785ce-c2d6-41e2-a529-ff266689e287" status: 200 len: 1518 microversion: 2.1 time: 0.154935 Jan 24 09:24:55.021864 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 556/1109] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:24:54 2022] GET /compute/v2.1/servers/2d0785ce-c2d6-41e2-a529-ff266689e287 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:24:55.084782 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-cf99a5cc-4264-448d-836f-0a5463df9d08 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:24:55.085314 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-cf99a5cc-4264-448d-836f-0a5463df9d08 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:55.091755 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-cf99a5cc-4264-448d-836f-0a5463df9d08 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:55.092262 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-cf99a5cc-4264-448d-836f-0a5463df9d08 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:55.093044 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-cf99a5cc-4264-448d-836f-0a5463df9d08 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:55.093476 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-cf99a5cc-4264-448d-836f-0a5463df9d08 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:55.122417 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-cf99a5cc-4264-448d-836f-0a5463df9d08 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/os-volume_attachments/5ce66a2b-0eb2-46ca-9cb7-543d4d3b7cd7" status: 200 len: 194 microversion: 2.1 time: 0.041163 Jan 24 09:24:55.123684 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 554/1110] 10.222.0.113 () {58 vars in 1417 bytes} [Mon Jan 24 09:24:55 2022] GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/os-volume_attachments/5ce66a2b-0eb2-46ca-9cb7-543d4d3b7cd7 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:24:55.133206 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-bb9833c6-e8fe-4e6b-8914-1f2089c85e2f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:24:55.133703 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-bb9833c6-e8fe-4e6b-8914-1f2089c85e2f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:55.140404 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-bb9833c6-e8fe-4e6b-8914-1f2089c85e2f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:55.140859 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-bb9833c6-e8fe-4e6b-8914-1f2089c85e2f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:55.141779 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-bb9833c6-e8fe-4e6b-8914-1f2089c85e2f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:55.142109 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-bb9833c6-e8fe-4e6b-8914-1f2089c85e2f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:55.222585 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.objects.instance [None req-bb9833c6-e8fe-4e6b-8914-1f2089c85e2f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lazy-loading 'services' on Instance uuid f3b808fd-b585-4062-a321-9965f704ffe6 {{(pid=116864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 09:24:55.444125 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-bb9833c6-e8fe-4e6b-8914-1f2089c85e2f tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "DELETE /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/os-volume_attachments/5ce66a2b-0eb2-46ca-9cb7-543d4d3b7cd7" status: 202 len: 0 microversion: 2.1 time: 0.314488 Jan 24 09:24:55.444970 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 557/1111] 10.222.0.113 () {58 vars in 1420 bytes} [Mon Jan 24 09:24:55 2022] DELETE /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/os-volume_attachments/5ce66a2b-0eb2-46ca-9cb7-543d4d3b7cd7 => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:24:56.038922 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-c9268ed9-fe49-4697-8abf-e25596f8ae56 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:24:56.039543 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-c9268ed9-fe49-4697-8abf-e25596f8ae56 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] [instance: 2d0785ce-c2d6-41e2-a529-ff266689e287] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:56.045436 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c9268ed9-fe49-4697-8abf-e25596f8ae56 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:56.045888 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c9268ed9-fe49-4697-8abf-e25596f8ae56 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:56.046720 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c9268ed9-fe49-4697-8abf-e25596f8ae56 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:56.047165 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-c9268ed9-fe49-4697-8abf-e25596f8ae56 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:56.259929 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-c9268ed9-fe49-4697-8abf-e25596f8ae56 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7dd4e5c6c9f467dab0d6b069d51b627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c949bc4951b4373b064a77e47c3dc8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:56.267724 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-c9268ed9-fe49-4697-8abf-e25596f8ae56 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] 10.222.0.113 "GET /compute/v2.1/servers/2d0785ce-c2d6-41e2-a529-ff266689e287" status: 200 len: 1518 microversion: 2.1 time: 0.232769 Jan 24 09:24:56.270276 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 555/1112] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:24:56 2022] GET /compute/v2.1/servers/2d0785ce-c2d6-41e2-a529-ff266689e287 => generated 1518 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:24:56.461566 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [req-1f80eec5-a3e9-44dd-8632-ac3817c7091e req-b2cb02d9-d2f5-4c31-8195-0b1915a2827c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d0785ce-c2d6-41e2-a529-ff266689e287", "name": "network-vif-deleted", "tag": "af44ef74-9065-4c31-aa65-3262cf173e00"}]} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:24:56.463211 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:24:56.463211 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: warnings.warn(msg) Jan 24 09:24:56.470625 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-1f80eec5-a3e9-44dd-8632-ac3817c7091e req-b2cb02d9-d2f5-4c31-8195-0b1915a2827c service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:56.471210 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-1f80eec5-a3e9-44dd-8632-ac3817c7091e req-b2cb02d9-d2f5-4c31-8195-0b1915a2827c service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:56.482517 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.compute.server_external_events [req-1f80eec5-a3e9-44dd-8632-ac3817c7091e req-b2cb02d9-d2f5-4c31-8195-0b1915a2827c service nova] Creating event network-vif-deleted:af44ef74-9065-4c31-aa65-3262cf173e00 for instance 2d0785ce-c2d6-41e2-a529-ff266689e287 on hv-cinder-80403 Jan 24 09:24:56.487503 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [req-1f80eec5-a3e9-44dd-8632-ac3817c7091e req-b2cb02d9-d2f5-4c31-8195-0b1915a2827c service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031013 Jan 24 09:24:56.488095 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 558/1113] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:24:56.600271 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-b1e34d5f-69c2-4012-b31d-146e36712392 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:24:56.601228 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-b1e34d5f-69c2-4012-b31d-146e36712392 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:56.608130 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b1e34d5f-69c2-4012-b31d-146e36712392 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:56.608567 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b1e34d5f-69c2-4012-b31d-146e36712392 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:56.609396 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b1e34d5f-69c2-4012-b31d-146e36712392 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:56.609825 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b1e34d5f-69c2-4012-b31d-146e36712392 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:56.640149 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-b1e34d5f-69c2-4012-b31d-146e36712392 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043612 Jan 24 09:24:56.640723 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 556/1114] 10.222.0.113 () {58 vars in 1306 bytes} [Mon Jan 24 09:24:56 2022] GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:24:57.284242 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-4c6ca939-5669-474b-9128-13bdd9b94183 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:24:57.284980 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-4c6ca939-5669-474b-9128-13bdd9b94183 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] [instance: 2d0785ce-c2d6-41e2-a529-ff266689e287] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:57.291602 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4c6ca939-5669-474b-9128-13bdd9b94183 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:57.292059 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4c6ca939-5669-474b-9128-13bdd9b94183 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:57.292867 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4c6ca939-5669-474b-9128-13bdd9b94183 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:57.293284 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4c6ca939-5669-474b-9128-13bdd9b94183 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:57.324825 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4c6ca939-5669-474b-9128-13bdd9b94183 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:57.325276 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4c6ca939-5669-474b-9128-13bdd9b94183 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:57.325725 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.objects.instance [None req-4c6ca939-5669-474b-9128-13bdd9b94183 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lazy-loading 'fault' on Instance uuid 2d0785ce-c2d6-41e2-a529-ff266689e287 {{(pid=116864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 09:24:57.366298 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-4c6ca939-5669-474b-9128-13bdd9b94183 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7dd4e5c6c9f467dab0d6b069d51b627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c949bc4951b4373b064a77e47c3dc8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:57.373768 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-4c6ca939-5669-474b-9128-13bdd9b94183 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] 10.222.0.113 "GET /compute/v2.1/servers/2d0785ce-c2d6-41e2-a529-ff266689e287" status: 200 len: 1313 microversion: 2.1 time: 0.093640 Jan 24 09:24:57.374630 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 559/1115] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:24:57 2022] GET /compute/v2.1/servers/2d0785ce-c2d6-41e2-a529-ff266689e287 => generated 1313 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:24:57.651749 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-54b4089e-6c1c-45a4-b498-8e8860f3421c tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:24:57.652700 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-54b4089e-6c1c-45a4-b498-8e8860f3421c tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:57.659987 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-54b4089e-6c1c-45a4-b498-8e8860f3421c tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:57.660440 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-54b4089e-6c1c-45a4-b498-8e8860f3421c tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:57.661230 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-54b4089e-6c1c-45a4-b498-8e8860f3421c tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:57.661666 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-54b4089e-6c1c-45a4-b498-8e8860f3421c tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:57.690981 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-54b4089e-6c1c-45a4-b498-8e8860f3421c tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042984 Jan 24 09:24:57.691607 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 557/1116] 10.222.0.113 () {58 vars in 1306 bytes} [Mon Jan 24 09:24:57 2022] GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 09:24:57.792416 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-f876233d-1cd9-456d-9b0a-228ae9e85943 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:24:57.793376 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-f876233d-1cd9-456d-9b0a-228ae9e85943 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:57.799850 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f876233d-1cd9-456d-9b0a-228ae9e85943 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:57.800290 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f876233d-1cd9-456d-9b0a-228ae9e85943 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:57.801059 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f876233d-1cd9-456d-9b0a-228ae9e85943 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:57.801493 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f876233d-1cd9-456d-9b0a-228ae9e85943 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:57.831638 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-f876233d-1cd9-456d-9b0a-228ae9e85943 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043201 Jan 24 09:24:57.832217 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 560/1117] 10.222.0.113 () {58 vars in 1306 bytes} [Mon Jan 24 09:24:57 2022] GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 09:24:57.886952 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-880219e3-1173-499d-9b55-f51130be756a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:24:57.887453 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-880219e3-1173-499d-9b55-f51130be756a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:57.897630 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-880219e3-1173-499d-9b55-f51130be756a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:57.898077 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-880219e3-1173-499d-9b55-f51130be756a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:57.898904 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-880219e3-1173-499d-9b55-f51130be756a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:57.899346 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-880219e3-1173-499d-9b55-f51130be756a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:57.925325 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-880219e3-1173-499d-9b55-f51130be756a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Going to try to terminate instance {{(pid=116863) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 09:24:58.187780 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-880219e3-1173-499d-9b55-f51130be756a tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "DELETE /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6" status: 204 len: 0 microversion: 2.1 time: 0.304168 Jan 24 09:24:58.188419 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 558/1118] 10.222.0.113 () {58 vars in 1243 bytes} [Mon Jan 24 09:24:57 2022] DELETE /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 24 09:24:58.196322 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-1598a2bc-3f35-45e0-af8d-180eb383f0f1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:24:58.196934 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-1598a2bc-3f35-45e0-af8d-180eb383f0f1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:58.204286 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1598a2bc-3f35-45e0-af8d-180eb383f0f1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:58.204741 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1598a2bc-3f35-45e0-af8d-180eb383f0f1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:58.205527 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1598a2bc-3f35-45e0-af8d-180eb383f0f1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:58.205966 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1598a2bc-3f35-45e0-af8d-180eb383f0f1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:58.350610 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-1598a2bc-3f35-45e0-af8d-180eb383f0f1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:58.358791 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-1598a2bc-3f35-45e0-af8d-180eb383f0f1 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6" status: 200 len: 1678 microversion: 2.1 time: 0.166110 Jan 24 09:24:58.359456 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 561/1119] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:24:58 2022] GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6 => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:24:58.390971 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-12b0c380-4bdf-40d0-8280-1e66033cbe8d tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:24:58.391778 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-12b0c380-4bdf-40d0-8280-1e66033cbe8d tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] [instance: 2d0785ce-c2d6-41e2-a529-ff266689e287] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:58.398291 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-12b0c380-4bdf-40d0-8280-1e66033cbe8d tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:58.398738 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-12b0c380-4bdf-40d0-8280-1e66033cbe8d tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:58.399514 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-12b0c380-4bdf-40d0-8280-1e66033cbe8d tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:58.399947 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-12b0c380-4bdf-40d0-8280-1e66033cbe8d tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:58.414508 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.wsgi [None req-12b0c380-4bdf-40d0-8280-1e66033cbe8d tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] HTTP exception thrown: Instance 2d0785ce-c2d6-41e2-a529-ff266689e287 could not be found. Jan 24 09:24:58.415085 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-12b0c380-4bdf-40d0-8280-1e66033cbe8d tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Returning 404 to user: Instance 2d0785ce-c2d6-41e2-a529-ff266689e287 could not be found. {{(pid=116863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:24:58.415901 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-12b0c380-4bdf-40d0-8280-1e66033cbe8d tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] 10.222.0.113 "GET /compute/v2.1/servers/2d0785ce-c2d6-41e2-a529-ff266689e287" status: 404 len: 111 microversion: 2.1 time: 0.029104 Jan 24 09:24:58.416452 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 559/1120] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:24:58 2022] GET /compute/v2.1/servers/2d0785ce-c2d6-41e2-a529-ff266689e287 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 09:24:59.376179 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-7bf4bc35-9945-4ae4-9e6f-30fb2985ef21 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:24:59.376790 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-7bf4bc35-9945-4ae4-9e6f-30fb2985ef21 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:24:59.383285 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-7bf4bc35-9945-4ae4-9e6f-30fb2985ef21 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:59.385781 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-7bf4bc35-9945-4ae4-9e6f-30fb2985ef21 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:59.385781 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-7bf4bc35-9945-4ae4-9e6f-30fb2985ef21 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:24:59.385781 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-7bf4bc35-9945-4ae4-9e6f-30fb2985ef21 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:24:59.518490 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-7bf4bc35-9945-4ae4-9e6f-30fb2985ef21 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:24:59.526139 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-7bf4bc35-9945-4ae4-9e6f-30fb2985ef21 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6" status: 200 len: 1678 microversion: 2.1 time: 0.153653 Jan 24 09:24:59.526733 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 562/1121] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:24:59 2022] GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:25:00.544293 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-5922eff1-48b2-4587-a33f-32c2f28e3eec tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:25:00.545571 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-5922eff1-48b2-4587-a33f-32c2f28e3eec tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:25:00.552539 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5922eff1-48b2-4587-a33f-32c2f28e3eec tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:00.552980 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5922eff1-48b2-4587-a33f-32c2f28e3eec tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:00.553753 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5922eff1-48b2-4587-a33f-32c2f28e3eec tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:00.554225 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5922eff1-48b2-4587-a33f-32c2f28e3eec tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:00.686602 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-5922eff1-48b2-4587-a33f-32c2f28e3eec tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:25:00.694030 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-5922eff1-48b2-4587-a33f-32c2f28e3eec tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6" status: 200 len: 1678 microversion: 2.1 time: 0.153598 Jan 24 09:25:00.694625 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 560/1122] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:25:00 2022] GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:25:01.711534 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-87f6074c-bfb8-4cd8-931c-4bef9ca2b727 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:25:01.712079 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-87f6074c-bfb8-4cd8-931c-4bef9ca2b727 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:25:01.718814 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-87f6074c-bfb8-4cd8-931c-4bef9ca2b727 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:01.719258 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-87f6074c-bfb8-4cd8-931c-4bef9ca2b727 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:01.720028 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-87f6074c-bfb8-4cd8-931c-4bef9ca2b727 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:01.720462 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-87f6074c-bfb8-4cd8-931c-4bef9ca2b727 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:01.852480 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-87f6074c-bfb8-4cd8-931c-4bef9ca2b727 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:25:01.860570 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-87f6074c-bfb8-4cd8-931c-4bef9ca2b727 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6" status: 200 len: 1678 microversion: 2.1 time: 0.152807 Jan 24 09:25:01.861135 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 563/1123] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:25:01 2022] GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:25:02.876617 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-96d39240-d7bc-4887-9a48-3494319f7a77 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:25:02.877211 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-96d39240-d7bc-4887-9a48-3494319f7a77 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:25:02.883662 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-96d39240-d7bc-4887-9a48-3494319f7a77 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:02.884121 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-96d39240-d7bc-4887-9a48-3494319f7a77 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:02.884907 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-96d39240-d7bc-4887-9a48-3494319f7a77 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:02.885347 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-96d39240-d7bc-4887-9a48-3494319f7a77 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:03.053278 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-96d39240-d7bc-4887-9a48-3494319f7a77 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:25:03.063560 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-96d39240-d7bc-4887-9a48-3494319f7a77 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6" status: 200 len: 1678 microversion: 2.1 time: 0.187957 Jan 24 09:25:03.063560 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 561/1124] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:25:02 2022] GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6 => generated 1678 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:25:03.392487 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [req-3f828f42-c2c7-437f-bb20-83d1b1f4f8e1 req-24c4ec73-09cb-48b0-9229-77f8ba00d72f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3b808fd-b585-4062-a321-9965f704ffe6", "name": "network-vif-deleted", "tag": "27389513-03ea-4e61-98b8-afb32fb7a007"}]} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:25:03.394652 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:25:03.394652 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: warnings.warn(msg) Jan 24 09:25:03.402243 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-3f828f42-c2c7-437f-bb20-83d1b1f4f8e1 req-24c4ec73-09cb-48b0-9229-77f8ba00d72f service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:03.402692 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-3f828f42-c2c7-437f-bb20-83d1b1f4f8e1 req-24c4ec73-09cb-48b0-9229-77f8ba00d72f service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:03.415380 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.compute.server_external_events [req-3f828f42-c2c7-437f-bb20-83d1b1f4f8e1 req-24c4ec73-09cb-48b0-9229-77f8ba00d72f service nova] Creating event network-vif-deleted:27389513-03ea-4e61-98b8-afb32fb7a007 for instance f3b808fd-b585-4062-a321-9965f704ffe6 on hv-cinder-80403 Jan 24 09:25:03.421274 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [req-3f828f42-c2c7-437f-bb20-83d1b1f4f8e1 req-24c4ec73-09cb-48b0-9229-77f8ba00d72f service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038853 Jan 24 09:25:03.423090 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 564/1125] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:25:04.079240 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-5679a9d5-a575-4106-af25-91c72982fcb5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:25:04.080046 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-5679a9d5-a575-4106-af25-91c72982fcb5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:25:04.086601 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5679a9d5-a575-4106-af25-91c72982fcb5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:04.087099 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5679a9d5-a575-4106-af25-91c72982fcb5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:04.091237 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5679a9d5-a575-4106-af25-91c72982fcb5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:04.091237 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5679a9d5-a575-4106-af25-91c72982fcb5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:04.121233 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5679a9d5-a575-4106-af25-91c72982fcb5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:04.121910 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-5679a9d5-a575-4106-af25-91c72982fcb5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:04.122969 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.objects.instance [None req-5679a9d5-a575-4106-af25-91c72982fcb5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lazy-loading 'fault' on Instance uuid f3b808fd-b585-4062-a321-9965f704ffe6 {{(pid=116863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 09:25:04.165181 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-5679a9d5-a575-4106-af25-91c72982fcb5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474c62f3a5d4363ba48daf145765db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc910091533410a986175bf4570f541', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:25:04.173034 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-5679a9d5-a575-4106-af25-91c72982fcb5 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6" status: 200 len: 1331 microversion: 2.1 time: 0.098652 Jan 24 09:25:04.173597 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 562/1126] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:25:04 2022] GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6 => generated 1331 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:25:05.192509 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-c57ca2a2-8ac7-44f0-94bd-7743eb1208ce tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:25:05.193209 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-c57ca2a2-8ac7-44f0-94bd-7743eb1208ce tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:25:05.199386 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c57ca2a2-8ac7-44f0-94bd-7743eb1208ce tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:05.199835 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c57ca2a2-8ac7-44f0-94bd-7743eb1208ce tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:05.200615 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c57ca2a2-8ac7-44f0-94bd-7743eb1208ce tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:05.201051 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c57ca2a2-8ac7-44f0-94bd-7743eb1208ce tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:05.214288 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.wsgi [None req-c57ca2a2-8ac7-44f0-94bd-7743eb1208ce tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] HTTP exception thrown: Instance f3b808fd-b585-4062-a321-9965f704ffe6 could not be found. Jan 24 09:25:05.214870 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-c57ca2a2-8ac7-44f0-94bd-7743eb1208ce tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Returning 404 to user: Instance f3b808fd-b585-4062-a321-9965f704ffe6 could not be found. {{(pid=116864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:25:05.215693 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-c57ca2a2-8ac7-44f0-94bd-7743eb1208ce tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6" status: 404 len: 111 microversion: 2.1 time: 0.027794 Jan 24 09:25:05.216232 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 565/1127] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:25:05 2022] GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 09:25:05.224625 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-724ad83b-6d2c-4e34-9c88-b7eafc4c4869 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '.version_select at 0x7f473dc13700>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:25:05.330950 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-724ad83b-6d2c-4e34-9c88-b7eafc4c4869 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-107360112" status: 202 len: 0 microversion: 2.1 time: 0.109940 Jan 24 09:25:05.331537 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 563/1128] 10.222.0.113 () {58 vars in 1222 bytes} [Mon Jan 24 09:25:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-107360112 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:25:08.924367 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-dc990542-1c3f-4728-aa92-7c1481e3000d tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1055013546", "imageRef": "c527e37f-a381-465e-babe-11528029ed9b", "flavorRef": "452", "networks": [{"uuid": "c4cf2215-2834-4f58-92b9-07bf71222c87"}]}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:25:08.976618 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.network.neutron [None req-dc990542-1c3f-4728-aa92-7c1481e3000d tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] validate_networks() for [('c4cf2215-2834-4f58-92b9-07bf71222c87', None, None, None, None, None)] {{(pid=116864) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 09:25:09.334407 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-dc990542-1c3f-4728-aa92-7c1481e3000d tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Flavor limits 0:0:0 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 09:25:09.334407 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-dc990542-1c3f-4728-aa92-7c1481e3000d tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Image limits 0:0:0 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 09:25:09.334407 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-dc990542-1c3f-4728-aa92-7c1481e3000d tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Flavor pref 0:0:0 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 09:25:09.334407 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-dc990542-1c3f-4728-aa92-7c1481e3000d tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Image pref 0:0:0 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 09:25:09.334407 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-dc990542-1c3f-4728-aa92-7c1481e3000d tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 09:25:09.342498 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-dc990542-1c3f-4728-aa92-7c1481e3000d tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:09.342881 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-dc990542-1c3f-4728-aa92-7c1481e3000d tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:09.343678 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-dc990542-1c3f-4728-aa92-7c1481e3000d tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:09.344109 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-dc990542-1c3f-4728-aa92-7c1481e3000d tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:09.360473 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.quota [None req-dc990542-1c3f-4728-aa92-7c1481e3000d tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Getting quotas for project 1c949bc4951b4373b064a77e47c3dc8d. Resources: {'ram', 'cores', 'instances'} {{(pid=116864) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 09:25:09.365793 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.quota [None req-dc990542-1c3f-4728-aa92-7c1481e3000d tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Getting quotas for user b7dd4e5c6c9f467dab0d6b069d51b627 and project 1c949bc4951b4373b064a77e47c3dc8d. Resources: {'ram', 'cores', 'instances'} {{(pid=116864) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 09:25:09.375388 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-dc990542-1c3f-4728-aa92-7c1481e3000d tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Going to run 1 instances... {{(pid=116864) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 09:25:09.377797 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-dc990542-1c3f-4728-aa92-7c1481e3000d tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] [instance: aace0c79-a7fc-4876-9a88-38057e742bbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c527e37f-a381-465e-babe-11528029ed9b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 09:25:09.506289 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-dc990542-1c3f-4728-aa92-7c1481e3000d tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.585453 Jan 24 09:25:09.506944 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 566/1129] 10.222.0.113 () {60 vars in 1151 bytes} [Mon Jan 24 09:25:08 2022] POST /compute/v2.1/servers => generated 382 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 24 09:25:09.517777 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-b3fb01af-12ae-4534-ae5d-fc0d2fa66352 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:25:09.523750 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-b3fb01af-12ae-4534-ae5d-fc0d2fa66352 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] [instance: aace0c79-a7fc-4876-9a88-38057e742bbd] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:25:09.579392 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-b3fb01af-12ae-4534-ae5d-fc0d2fa66352 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7dd4e5c6c9f467dab0d6b069d51b627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c949bc4951b4373b064a77e47c3dc8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:25:09.588307 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-b3fb01af-12ae-4534-ae5d-fc0d2fa66352 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] 10.222.0.113 "GET /compute/v2.1/servers/aace0c79-a7fc-4876-9a88-38057e742bbd" status: 200 len: 1223 microversion: 2.1 time: 0.075204 Jan 24 09:25:09.588917 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 564/1130] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:25:09 2022] GET /compute/v2.1/servers/aace0c79-a7fc-4876-9a88-38057e742bbd => generated 1223 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:25:09.821718 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-0c07e145-90e5-4446-a636-bb2fb5389f42 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:25:09.822234 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-0c07e145-90e5-4446-a636-bb2fb5389f42 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:25:09.828946 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0c07e145-90e5-4446-a636-bb2fb5389f42 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:09.829386 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0c07e145-90e5-4446-a636-bb2fb5389f42 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:09.830187 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0c07e145-90e5-4446-a636-bb2fb5389f42 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:09.830619 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0c07e145-90e5-4446-a636-bb2fb5389f42 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:09.844905 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.wsgi [None req-0c07e145-90e5-4446-a636-bb2fb5389f42 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] HTTP exception thrown: Instance f3b808fd-b585-4062-a321-9965f704ffe6 could not be found. Jan 24 09:25:09.845487 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-0c07e145-90e5-4446-a636-bb2fb5389f42 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Returning 404 to user: Instance f3b808fd-b585-4062-a321-9965f704ffe6 could not be found. {{(pid=116864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:25:09.846336 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-0c07e145-90e5-4446-a636-bb2fb5389f42 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "DELETE /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6" status: 404 len: 111 microversion: 2.1 time: 0.028536 Jan 24 09:25:09.846883 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 567/1131] 10.222.0.113 () {58 vars in 1243 bytes} [Mon Jan 24 09:25:09 2022] DELETE /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 09:25:09.854999 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-eec24df7-8de5-42bb-8b82-3404e1f592f0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:25:09.855539 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-eec24df7-8de5-42bb-8b82-3404e1f592f0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: f3b808fd-b585-4062-a321-9965f704ffe6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:25:09.862019 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-eec24df7-8de5-42bb-8b82-3404e1f592f0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:09.862617 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-eec24df7-8de5-42bb-8b82-3404e1f592f0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:09.863291 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-eec24df7-8de5-42bb-8b82-3404e1f592f0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:09.863730 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-eec24df7-8de5-42bb-8b82-3404e1f592f0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:09.879076 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.wsgi [None req-eec24df7-8de5-42bb-8b82-3404e1f592f0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] HTTP exception thrown: Instance f3b808fd-b585-4062-a321-9965f704ffe6 could not be found. Jan 24 09:25:09.879683 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-eec24df7-8de5-42bb-8b82-3404e1f592f0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Returning 404 to user: Instance f3b808fd-b585-4062-a321-9965f704ffe6 could not be found. {{(pid=116863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:25:09.880529 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-eec24df7-8de5-42bb-8b82-3404e1f592f0 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6" status: 404 len: 111 microversion: 2.1 time: 0.029671 Jan 24 09:25:09.881143 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 565/1132] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:25:09 2022] GET /compute/v2.1/servers/f3b808fd-b585-4062-a321-9965f704ffe6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 09:25:10.605775 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-22b07a5c-e70a-40e4-af65-a06d7a0c2973 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:25:10.606455 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-22b07a5c-e70a-40e4-af65-a06d7a0c2973 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] [instance: aace0c79-a7fc-4876-9a88-38057e742bbd] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:25:10.613018 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-22b07a5c-e70a-40e4-af65-a06d7a0c2973 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:10.618919 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-22b07a5c-e70a-40e4-af65-a06d7a0c2973 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:10.618919 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-22b07a5c-e70a-40e4-af65-a06d7a0c2973 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:10.618919 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-22b07a5c-e70a-40e4-af65-a06d7a0c2973 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:10.676648 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-22b07a5c-e70a-40e4-af65-a06d7a0c2973 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7dd4e5c6c9f467dab0d6b069d51b627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c949bc4951b4373b064a77e47c3dc8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:25:10.684544 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-22b07a5c-e70a-40e4-af65-a06d7a0c2973 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] 10.222.0.113 "GET /compute/v2.1/servers/aace0c79-a7fc-4876-9a88-38057e742bbd" status: 200 len: 1227 microversion: 2.1 time: 0.082312 Jan 24 09:25:10.684864 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 568/1133] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:25:10 2022] GET /compute/v2.1/servers/aace0c79-a7fc-4876-9a88-38057e742bbd => generated 1227 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:25:11.140625 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-8a4e59cf-5f9c-4ff7-a354-4644f8e99752 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:25:11.141164 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-8a4e59cf-5f9c-4ff7-a354-4644f8e99752 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:25:11.147422 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8a4e59cf-5f9c-4ff7-a354-4644f8e99752 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:11.147860 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8a4e59cf-5f9c-4ff7-a354-4644f8e99752 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:11.148634 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8a4e59cf-5f9c-4ff7-a354-4644f8e99752 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:11.149060 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8a4e59cf-5f9c-4ff7-a354-4644f8e99752 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:11.162181 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.wsgi [None req-8a4e59cf-5f9c-4ff7-a354-4644f8e99752 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] HTTP exception thrown: Instance c7421454-e5c9-4ecb-8afb-928a7042b789 could not be found. Jan 24 09:25:11.162767 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-8a4e59cf-5f9c-4ff7-a354-4644f8e99752 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Returning 404 to user: Instance c7421454-e5c9-4ecb-8afb-928a7042b789 could not be found. {{(pid=116863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:25:11.163853 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-8a4e59cf-5f9c-4ff7-a354-4644f8e99752 tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "DELETE /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 404 len: 111 microversion: 2.1 time: 0.027606 Jan 24 09:25:11.164393 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 566/1134] 10.222.0.113 () {58 vars in 1243 bytes} [Mon Jan 24 09:25:11 2022] DELETE /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 09:25:11.173102 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-a764ee29-9e53-4b75-97ed-9cd22c0605ee tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:25:11.173744 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-a764ee29-9e53-4b75-97ed-9cd22c0605ee tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] [instance: c7421454-e5c9-4ecb-8afb-928a7042b789] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:25:11.179630 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a764ee29-9e53-4b75-97ed-9cd22c0605ee tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:11.180107 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a764ee29-9e53-4b75-97ed-9cd22c0605ee tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:11.180887 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a764ee29-9e53-4b75-97ed-9cd22c0605ee tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:11.181329 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a764ee29-9e53-4b75-97ed-9cd22c0605ee tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:11.196426 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.wsgi [None req-a764ee29-9e53-4b75-97ed-9cd22c0605ee tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] HTTP exception thrown: Instance c7421454-e5c9-4ecb-8afb-928a7042b789 could not be found. Jan 24 09:25:11.197023 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-a764ee29-9e53-4b75-97ed-9cd22c0605ee tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] Returning 404 to user: Instance c7421454-e5c9-4ecb-8afb-928a7042b789 could not be found. {{(pid=116864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:25:11.197849 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-a764ee29-9e53-4b75-97ed-9cd22c0605ee tempest-AttachVolumeTestJSON-332436479 tempest-AttachVolumeTestJSON-332436479-project] 10.222.0.113 "GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789" status: 404 len: 111 microversion: 2.1 time: 0.029078 Jan 24 09:25:11.198434 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 569/1135] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:25:11 2022] GET /compute/v2.1/servers/c7421454-e5c9-4ecb-8afb-928a7042b789 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 09:25:11.701892 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-1e31d0fb-7712-4fcf-b590-db7444ec3a42 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:25:11.702440 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-1e31d0fb-7712-4fcf-b590-db7444ec3a42 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] [instance: aace0c79-a7fc-4876-9a88-38057e742bbd] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:25:11.708567 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1e31d0fb-7712-4fcf-b590-db7444ec3a42 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:11.709024 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1e31d0fb-7712-4fcf-b590-db7444ec3a42 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:11.709831 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1e31d0fb-7712-4fcf-b590-db7444ec3a42 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:11.710455 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1e31d0fb-7712-4fcf-b590-db7444ec3a42 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:11.807825 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-1e31d0fb-7712-4fcf-b590-db7444ec3a42 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7dd4e5c6c9f467dab0d6b069d51b627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c949bc4951b4373b064a77e47c3dc8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:25:11.816018 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-1e31d0fb-7712-4fcf-b590-db7444ec3a42 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] 10.222.0.113 "GET /compute/v2.1/servers/aace0c79-a7fc-4876-9a88-38057e742bbd" status: 200 len: 1293 microversion: 2.1 time: 0.119099 Jan 24 09:25:11.816606 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 567/1136] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:25:11 2022] GET /compute/v2.1/servers/aace0c79-a7fc-4876-9a88-38057e742bbd => generated 1293 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:25:12.832612 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-b3487b38-4426-420f-b9c0-1022d0461bf0 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:25:12.833242 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-b3487b38-4426-420f-b9c0-1022d0461bf0 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] [instance: aace0c79-a7fc-4876-9a88-38057e742bbd] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:25:12.840728 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b3487b38-4426-420f-b9c0-1022d0461bf0 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:12.841171 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b3487b38-4426-420f-b9c0-1022d0461bf0 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:12.842658 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b3487b38-4426-420f-b9c0-1022d0461bf0 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:12.843062 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b3487b38-4426-420f-b9c0-1022d0461bf0 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:12.992399 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-b3487b38-4426-420f-b9c0-1022d0461bf0 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7dd4e5c6c9f467dab0d6b069d51b627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c949bc4951b4373b064a77e47c3dc8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:25:13.001661 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-b3487b38-4426-420f-b9c0-1022d0461bf0 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] 10.222.0.113 "GET /compute/v2.1/servers/aace0c79-a7fc-4876-9a88-38057e742bbd" status: 200 len: 1323 microversion: 2.1 time: 0.172683 Jan 24 09:25:13.002508 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 570/1137] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:25:12 2022] GET /compute/v2.1/servers/aace0c79-a7fc-4876-9a88-38057e742bbd => generated 1323 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:25:14.019464 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-557197e2-4af9-4955-8a08-e0e11acc7354 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:25:14.021302 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-557197e2-4af9-4955-8a08-e0e11acc7354 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] [instance: aace0c79-a7fc-4876-9a88-38057e742bbd] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:25:14.027995 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-557197e2-4af9-4955-8a08-e0e11acc7354 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:14.028859 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-557197e2-4af9-4955-8a08-e0e11acc7354 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:14.029819 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-557197e2-4af9-4955-8a08-e0e11acc7354 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:14.031015 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-557197e2-4af9-4955-8a08-e0e11acc7354 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:14.229968 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-557197e2-4af9-4955-8a08-e0e11acc7354 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7dd4e5c6c9f467dab0d6b069d51b627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c949bc4951b4373b064a77e47c3dc8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:25:14.240601 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [req-be162d2b-56a4-4a88-9795-725c0e81ac40 req-46160d16-59fa-4520-86bf-54100e1862dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aace0c79-a7fc-4876-9a88-38057e742bbd", "tag": "c011af7c-0d62-46b5-a07e-00ca69f678b2"}]} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:25:14.241682 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-557197e2-4af9-4955-8a08-e0e11acc7354 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] 10.222.0.113 "GET /compute/v2.1/servers/aace0c79-a7fc-4876-9a88-38057e742bbd" status: 200 len: 1323 microversion: 2.1 time: 0.225414 Jan 24 09:25:14.243003 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:25:14.243003 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: warnings.warn(msg) Jan 24 09:25:14.251559 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-be162d2b-56a4-4a88-9795-725c0e81ac40 req-46160d16-59fa-4520-86bf-54100e1862dc service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:14.252262 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-be162d2b-56a4-4a88-9795-725c0e81ac40 req-46160d16-59fa-4520-86bf-54100e1862dc service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:14.252958 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 568/1138] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:25:14 2022] GET /compute/v2.1/servers/aace0c79-a7fc-4876-9a88-38057e742bbd => generated 1323 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:25:14.264776 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.compute.server_external_events [req-be162d2b-56a4-4a88-9795-725c0e81ac40 req-46160d16-59fa-4520-86bf-54100e1862dc service nova] Creating event network-changed:c011af7c-0d62-46b5-a07e-00ca69f678b2 for instance aace0c79-a7fc-4876-9a88-38057e742bbd on hv-cinder-80403 Jan 24 09:25:14.269321 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [req-be162d2b-56a4-4a88-9795-725c0e81ac40 req-46160d16-59fa-4520-86bf-54100e1862dc service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032375 Jan 24 09:25:14.270413 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 571/1139] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 09:25:15.258031 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-6c2f35e4-ed6d-4c61-b397-ebc2b6256c36 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:25:15.258614 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-6c2f35e4-ed6d-4c61-b397-ebc2b6256c36 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] [instance: aace0c79-a7fc-4876-9a88-38057e742bbd] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:25:15.265698 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6c2f35e4-ed6d-4c61-b397-ebc2b6256c36 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:15.266169 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6c2f35e4-ed6d-4c61-b397-ebc2b6256c36 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:15.266960 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6c2f35e4-ed6d-4c61-b397-ebc2b6256c36 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:15.267404 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6c2f35e4-ed6d-4c61-b397-ebc2b6256c36 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:15.429115 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-6c2f35e4-ed6d-4c61-b397-ebc2b6256c36 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7dd4e5c6c9f467dab0d6b069d51b627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c949bc4951b4373b064a77e47c3dc8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:25:15.438719 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-6c2f35e4-ed6d-4c61-b397-ebc2b6256c36 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] 10.222.0.113 "GET /compute/v2.1/servers/aace0c79-a7fc-4876-9a88-38057e742bbd" status: 200 len: 1323 microversion: 2.1 time: 0.184434 Jan 24 09:25:15.439423 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 569/1140] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:25:15 2022] GET /compute/v2.1/servers/aace0c79-a7fc-4876-9a88-38057e742bbd => generated 1323 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:25:16.457875 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-89c8022f-426a-4549-b3f9-5169a6631007 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:25:16.458653 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-89c8022f-426a-4549-b3f9-5169a6631007 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] [instance: aace0c79-a7fc-4876-9a88-38057e742bbd] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:25:16.465758 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-89c8022f-426a-4549-b3f9-5169a6631007 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:16.465969 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-89c8022f-426a-4549-b3f9-5169a6631007 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:16.467611 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-89c8022f-426a-4549-b3f9-5169a6631007 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:16.468065 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-89c8022f-426a-4549-b3f9-5169a6631007 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:16.637079 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-89c8022f-426a-4549-b3f9-5169a6631007 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7dd4e5c6c9f467dab0d6b069d51b627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c949bc4951b4373b064a77e47c3dc8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:25:16.645096 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-89c8022f-426a-4549-b3f9-5169a6631007 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] 10.222.0.113 "GET /compute/v2.1/servers/aace0c79-a7fc-4876-9a88-38057e742bbd" status: 200 len: 1323 microversion: 2.1 time: 0.191883 Jan 24 09:25:16.645659 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 572/1141] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:25:16 2022] GET /compute/v2.1/servers/aace0c79-a7fc-4876-9a88-38057e742bbd => generated 1323 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:25:17.661954 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-a6efec72-f9d1-41bb-97e7-ec338a9b730d tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:25:17.662863 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-a6efec72-f9d1-41bb-97e7-ec338a9b730d tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] [instance: aace0c79-a7fc-4876-9a88-38057e742bbd] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:25:17.669885 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a6efec72-f9d1-41bb-97e7-ec338a9b730d tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:17.670389 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a6efec72-f9d1-41bb-97e7-ec338a9b730d tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:17.671159 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a6efec72-f9d1-41bb-97e7-ec338a9b730d tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:17.671586 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a6efec72-f9d1-41bb-97e7-ec338a9b730d tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:17.806280 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-a6efec72-f9d1-41bb-97e7-ec338a9b730d tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7dd4e5c6c9f467dab0d6b069d51b627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c949bc4951b4373b064a77e47c3dc8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:25:17.813883 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-a6efec72-f9d1-41bb-97e7-ec338a9b730d tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] 10.222.0.113 "GET /compute/v2.1/servers/aace0c79-a7fc-4876-9a88-38057e742bbd" status: 200 len: 1323 microversion: 2.1 time: 0.155519 Jan 24 09:25:17.814519 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 570/1142] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:25:17 2022] GET /compute/v2.1/servers/aace0c79-a7fc-4876-9a88-38057e742bbd => generated 1323 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:25:18.830254 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-8488e0b1-9b63-4c06-8bfa-14d15001eaa2 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:25:18.831047 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-8488e0b1-9b63-4c06-8bfa-14d15001eaa2 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] [instance: aace0c79-a7fc-4876-9a88-38057e742bbd] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:25:18.839874 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-8488e0b1-9b63-4c06-8bfa-14d15001eaa2 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:18.840333 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-8488e0b1-9b63-4c06-8bfa-14d15001eaa2 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:18.841275 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-8488e0b1-9b63-4c06-8bfa-14d15001eaa2 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:18.841722 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-8488e0b1-9b63-4c06-8bfa-14d15001eaa2 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:18.983397 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-8488e0b1-9b63-4c06-8bfa-14d15001eaa2 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7dd4e5c6c9f467dab0d6b069d51b627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c949bc4951b4373b064a77e47c3dc8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:25:18.990932 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-8488e0b1-9b63-4c06-8bfa-14d15001eaa2 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] 10.222.0.113 "GET /compute/v2.1/servers/aace0c79-a7fc-4876-9a88-38057e742bbd" status: 200 len: 1323 microversion: 2.1 time: 0.164497 Jan 24 09:25:18.993368 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 573/1143] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:25:18 2022] GET /compute/v2.1/servers/aace0c79-a7fc-4876-9a88-38057e742bbd => generated 1323 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:25:19.138417 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [req-132bbec7-f78c-4f36-9606-7e1e77299554 req-fdf6310f-3d16-4445-93a8-ad9cfde95167 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aace0c79-a7fc-4876-9a88-38057e742bbd", "name": "network-vif-plugged", "status": "completed", "tag": "c011af7c-0d62-46b5-a07e-00ca69f678b2"}]} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:25:19.141390 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:25:19.141390 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: warnings.warn(msg) Jan 24 09:25:19.148790 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-132bbec7-f78c-4f36-9606-7e1e77299554 req-fdf6310f-3d16-4445-93a8-ad9cfde95167 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:19.149235 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-132bbec7-f78c-4f36-9606-7e1e77299554 req-fdf6310f-3d16-4445-93a8-ad9cfde95167 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:19.161703 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.compute.server_external_events [req-132bbec7-f78c-4f36-9606-7e1e77299554 req-fdf6310f-3d16-4445-93a8-ad9cfde95167 service nova] Creating event network-vif-plugged:c011af7c-0d62-46b5-a07e-00ca69f678b2 for instance aace0c79-a7fc-4876-9a88-38057e742bbd on hv-cinder-80403 Jan 24 09:25:19.167884 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [req-132bbec7-f78c-4f36-9606-7e1e77299554 req-fdf6310f-3d16-4445-93a8-ad9cfde95167 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033350 Jan 24 09:25:19.168995 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 571/1144] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:25:19.216444 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-ba104b03-f5d6-474a-9a79-d4c8fc6d9915 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:25:19.217440 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-ba104b03-f5d6-474a-9a79-d4c8fc6d9915 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:25:19.224670 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ba104b03-f5d6-474a-9a79-d4c8fc6d9915 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:19.225122 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ba104b03-f5d6-474a-9a79-d4c8fc6d9915 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:19.226173 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ba104b03-f5d6-474a-9a79-d4c8fc6d9915 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:19.226547 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-ba104b03-f5d6-474a-9a79-d4c8fc6d9915 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:19.271450 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-ba104b03-f5d6-474a-9a79-d4c8fc6d9915 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.059332 Jan 24 09:25:19.273701 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 574/1145] 10.222.0.113 () {60 vars in 1347 bytes} [Mon Jan 24 09:25:19 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:25:19.330873 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-d781c8a8-46fd-4536-bbf3-88485f4bb069 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:25:19.331466 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-d781c8a8-46fd-4536-bbf3-88485f4bb069 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:25:19.338986 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d781c8a8-46fd-4536-bbf3-88485f4bb069 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:19.339440 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d781c8a8-46fd-4536-bbf3-88485f4bb069 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:19.340235 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d781c8a8-46fd-4536-bbf3-88485f4bb069 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:19.340959 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d781c8a8-46fd-4536-bbf3-88485f4bb069 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:19.367415 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-d781c8a8-46fd-4536-bbf3-88485f4bb069 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Going to try to terminate instance {{(pid=116863) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 09:25:19.792227 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-d781c8a8-46fd-4536-bbf3-88485f4bb069 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "DELETE /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 204 len: 0 microversion: 2.20 time: 0.466329 Jan 24 09:25:19.792891 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 572/1146] 10.222.0.113 () {60 vars in 1284 bytes} [Mon Jan 24 09:25:19 2022] DELETE /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 24 09:25:19.808039 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-9328826b-9c4b-4573-9702-f8ea0389a204 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:25:19.808641 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-9328826b-9c4b-4573-9702-f8ea0389a204 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:25:19.814575 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-9328826b-9c4b-4573-9702-f8ea0389a204 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:19.815022 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-9328826b-9c4b-4573-9702-f8ea0389a204 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:19.815796 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-9328826b-9c4b-4573-9702-f8ea0389a204 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:19.816233 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-9328826b-9c4b-4573-9702-f8ea0389a204 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:19.987609 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-9328826b-9c4b-4573-9702-f8ea0389a204 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:25:19.995642 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-9328826b-9c4b-4573-9702-f8ea0389a204 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:25:19.997741 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-9328826b-9c4b-4573-9702-f8ea0389a204 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:25:19.999025 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-9328826b-9c4b-4573-9702-f8ea0389a204 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1725 microversion: 2.20 time: 0.194681 Jan 24 09:25:19.999594 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 575/1147] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:25:19 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1725 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:25:20.010141 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-03aeeced-2a3b-47bf-9a6d-848ae7b8f34d tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:25:20.011318 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-03aeeced-2a3b-47bf-9a6d-848ae7b8f34d tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] [instance: aace0c79-a7fc-4876-9a88-38057e742bbd] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:25:20.017960 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-03aeeced-2a3b-47bf-9a6d-848ae7b8f34d tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:20.018570 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-03aeeced-2a3b-47bf-9a6d-848ae7b8f34d tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:20.019525 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-03aeeced-2a3b-47bf-9a6d-848ae7b8f34d tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:20.020047 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-03aeeced-2a3b-47bf-9a6d-848ae7b8f34d tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:20.156106 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-03aeeced-2a3b-47bf-9a6d-848ae7b8f34d tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7dd4e5c6c9f467dab0d6b069d51b627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c949bc4951b4373b064a77e47c3dc8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:25:20.164651 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-03aeeced-2a3b-47bf-9a6d-848ae7b8f34d tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] 10.222.0.113 "GET /compute/v2.1/servers/aace0c79-a7fc-4876-9a88-38057e742bbd" status: 200 len: 1323 microversion: 2.1 time: 0.159471 Jan 24 09:25:20.167574 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 573/1148] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:25:20 2022] GET /compute/v2.1/servers/aace0c79-a7fc-4876-9a88-38057e742bbd => generated 1323 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:25:21.017316 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-c4db6b1e-cc31-422a-ae32-d677e27612a5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:25:21.017970 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-c4db6b1e-cc31-422a-ae32-d677e27612a5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:25:21.024569 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c4db6b1e-cc31-422a-ae32-d677e27612a5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:21.025026 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c4db6b1e-cc31-422a-ae32-d677e27612a5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:21.025810 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c4db6b1e-cc31-422a-ae32-d677e27612a5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:21.026306 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c4db6b1e-cc31-422a-ae32-d677e27612a5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:21.165699 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-c4db6b1e-cc31-422a-ae32-d677e27612a5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:25:21.174516 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-c4db6b1e-cc31-422a-ae32-d677e27612a5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:25:21.175985 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-c4db6b1e-cc31-422a-ae32-d677e27612a5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:25:21.177369 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-c4db6b1e-cc31-422a-ae32-d677e27612a5 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1725 microversion: 2.20 time: 0.164413 Jan 24 09:25:21.177937 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 576/1149] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:25:21 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:25:21.182418 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-2883e64f-90dd-4046-ae1c-e9648bc0ed15 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:25:21.183036 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-2883e64f-90dd-4046-ae1c-e9648bc0ed15 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] [instance: aace0c79-a7fc-4876-9a88-38057e742bbd] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:25:21.190588 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-2883e64f-90dd-4046-ae1c-e9648bc0ed15 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:21.191024 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-2883e64f-90dd-4046-ae1c-e9648bc0ed15 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:21.191814 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-2883e64f-90dd-4046-ae1c-e9648bc0ed15 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:21.192253 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-2883e64f-90dd-4046-ae1c-e9648bc0ed15 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:21.335102 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-2883e64f-90dd-4046-ae1c-e9648bc0ed15 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7dd4e5c6c9f467dab0d6b069d51b627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c949bc4951b4373b064a77e47c3dc8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:25:21.343499 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-2883e64f-90dd-4046-ae1c-e9648bc0ed15 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] 10.222.0.113 "GET /compute/v2.1/servers/aace0c79-a7fc-4876-9a88-38057e742bbd" status: 200 len: 1513 microversion: 2.1 time: 0.164680 Jan 24 09:25:21.344091 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 574/1150] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:25:21 2022] GET /compute/v2.1/servers/aace0c79-a7fc-4876-9a88-38057e742bbd => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:25:21.360332 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-98af3b73-f10b-4e37-98b2-0a1f854aed4c tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c4ce33a6-b35e-46c1-882b-90d5c533f03b", "device": "/dev/sdb"}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:25:21.362271 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-98af3b73-f10b-4e37-98b2-0a1f854aed4c tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] [instance: aace0c79-a7fc-4876-9a88-38057e742bbd] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:25:21.367882 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-98af3b73-f10b-4e37-98b2-0a1f854aed4c tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:21.368339 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-98af3b73-f10b-4e37-98b2-0a1f854aed4c tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:21.369119 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-98af3b73-f10b-4e37-98b2-0a1f854aed4c tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:21.369558 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-98af3b73-f10b-4e37-98b2-0a1f854aed4c tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:22.196676 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-a685719b-a1b2-45fb-976b-c82d85da67ff tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:25:22.197387 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-a685719b-a1b2-45fb-976b-c82d85da67ff tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:25:22.212589 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a685719b-a1b2-45fb-976b-c82d85da67ff tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:22.212835 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a685719b-a1b2-45fb-976b-c82d85da67ff tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:22.213626 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a685719b-a1b2-45fb-976b-c82d85da67ff tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:22.213794 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-98af3b73-f10b-4e37-98b2-0a1f854aed4c tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] 10.222.0.113 "POST /compute/v2.1/servers/aace0c79-a7fc-4876-9a88-38057e742bbd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.857726 Jan 24 09:25:22.214467 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 577/1151] 10.222.0.113 () {60 vars in 1327 bytes} [Mon Jan 24 09:25:21 2022] POST /compute/v2.1/servers/aace0c79-a7fc-4876-9a88-38057e742bbd/os-volume_attachments => generated 194 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:25:22.216655 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a685719b-a1b2-45fb-976b-c82d85da67ff tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:22.393482 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-a685719b-a1b2-45fb-976b-c82d85da67ff tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:25:22.406429 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-a685719b-a1b2-45fb-976b-c82d85da67ff tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:25:22.408263 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-a685719b-a1b2-45fb-976b-c82d85da67ff tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:25:22.411638 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-a685719b-a1b2-45fb-976b-c82d85da67ff tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1725 microversion: 2.20 time: 0.218849 Jan 24 09:25:22.413257 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 575/1152] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:25:22 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1725 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 09:25:22.737359 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [req-ce0eda48-1f0b-4cf3-b980-b8daa49455a2 req-06d2550e-4dbb-486c-a452-09483ef02d37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab1e93a3-324f-47fc-b6ef-173b16f4e6f9", "name": "network-vif-deleted", "tag": "11759d98-c43e-497b-a68d-7ce168a0cd80"}]} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:25:22.740148 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:25:22.740148 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: warnings.warn(msg) Jan 24 09:25:22.748219 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-ce0eda48-1f0b-4cf3-b980-b8daa49455a2 req-06d2550e-4dbb-486c-a452-09483ef02d37 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:22.748855 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-ce0eda48-1f0b-4cf3-b980-b8daa49455a2 req-06d2550e-4dbb-486c-a452-09483ef02d37 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:22.762044 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.compute.server_external_events [req-ce0eda48-1f0b-4cf3-b980-b8daa49455a2 req-06d2550e-4dbb-486c-a452-09483ef02d37 service nova] Creating event network-vif-deleted:11759d98-c43e-497b-a68d-7ce168a0cd80 for instance ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 on hv-cinder-80403 Jan 24 09:25:22.767742 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [req-ce0eda48-1f0b-4cf3-b980-b8daa49455a2 req-06d2550e-4dbb-486c-a452-09483ef02d37 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035928 Jan 24 09:25:22.768759 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 578/1153] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:25:23.441772 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-4de5ab09-9c31-4a80-80fe-ff9096ceee9e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:25:23.441772 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-4de5ab09-9c31-4a80-80fe-ff9096ceee9e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:25:23.441772 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4de5ab09-9c31-4a80-80fe-ff9096ceee9e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:23.441772 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4de5ab09-9c31-4a80-80fe-ff9096ceee9e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:23.442607 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4de5ab09-9c31-4a80-80fe-ff9096ceee9e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:23.442702 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4de5ab09-9c31-4a80-80fe-ff9096ceee9e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:23.478839 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4de5ab09-9c31-4a80-80fe-ff9096ceee9e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:23.479287 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4de5ab09-9c31-4a80-80fe-ff9096ceee9e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:23.479743 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.objects.instance [None req-4de5ab09-9c31-4a80-80fe-ff9096ceee9e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lazy-loading 'fault' on Instance uuid ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 {{(pid=116863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 09:25:23.522978 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-4de5ab09-9c31-4a80-80fe-ff9096ceee9e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:25:23.532292 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-4de5ab09-9c31-4a80-80fe-ff9096ceee9e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:25:23.534033 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-4de5ab09-9c31-4a80-80fe-ff9096ceee9e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3527d1517fb0466a8b6375e40870b474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bb7ee37f9545c7a38065c3e1a3b6c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:25:23.536995 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-4de5ab09-9c31-4a80-80fe-ff9096ceee9e tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 200 len: 1374 microversion: 2.20 time: 0.107340 Jan 24 09:25:23.536995 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 576/1154] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:25:23 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 1374 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 09:25:24.554834 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-3b8e9f6e-ed0d-463d-bbc5-af033afba566 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:25:24.555519 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-3b8e9f6e-ed0d-463d-bbc5-af033afba566 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:25:24.561934 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3b8e9f6e-ed0d-463d-bbc5-af033afba566 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:24.562427 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3b8e9f6e-ed0d-463d-bbc5-af033afba566 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:24.563216 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3b8e9f6e-ed0d-463d-bbc5-af033afba566 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:24.563657 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3b8e9f6e-ed0d-463d-bbc5-af033afba566 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:24.577151 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.wsgi [None req-3b8e9f6e-ed0d-463d-bbc5-af033afba566 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] HTTP exception thrown: Instance ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 could not be found. Jan 24 09:25:24.577741 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-3b8e9f6e-ed0d-463d-bbc5-af033afba566 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Returning 404 to user: Instance ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 could not be found. {{(pid=116864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:25:24.578620 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-3b8e9f6e-ed0d-463d-bbc5-af033afba566 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 404 len: 111 microversion: 2.20 time: 0.028405 Jan 24 09:25:24.579165 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 579/1155] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:25:24 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 24 09:25:24.587211 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-178d5459-d0b8-4da9-a1cf-e38ce71c1053 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '.version_select at 0x7f473dc0e040>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:25:24.691139 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-178d5459-d0b8-4da9-a1cf-e38ce71c1053 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-610263263" status: 204 len: 0 microversion: 2.20 time: 0.107143 Jan 24 09:25:24.691735 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 577/1156] 10.222.0.113 () {60 vars in 1263 bytes} [Mon Jan 24 09:25:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-610263263 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 24 09:25:27.121133 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-c19c2be6-505c-453e-9f45-c697f303ea32 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:25:27.121653 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-c19c2be6-505c-453e-9f45-c697f303ea32 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:25:27.128004 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c19c2be6-505c-453e-9f45-c697f303ea32 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:27.128454 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c19c2be6-505c-453e-9f45-c697f303ea32 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:27.130974 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c19c2be6-505c-453e-9f45-c697f303ea32 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:27.130974 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c19c2be6-505c-453e-9f45-c697f303ea32 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:27.143419 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.wsgi [None req-c19c2be6-505c-453e-9f45-c697f303ea32 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] HTTP exception thrown: Instance ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 could not be found. Jan 24 09:25:27.144002 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-c19c2be6-505c-453e-9f45-c697f303ea32 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Returning 404 to user: Instance ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 could not be found. {{(pid=116864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:25:27.144821 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-c19c2be6-505c-453e-9f45-c697f303ea32 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "DELETE /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 404 len: 111 microversion: 2.20 time: 0.027574 Jan 24 09:25:27.145348 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 580/1157] 10.222.0.113 () {60 vars in 1284 bytes} [Mon Jan 24 09:25:27 2022] DELETE /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 24 09:25:27.153930 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-191bb43a-4943-438a-a765-da4c726d25d2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:25:27.154862 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-191bb43a-4943-438a-a765-da4c726d25d2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: ab1e93a3-324f-47fc-b6ef-173b16f4e6f9] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:25:27.161714 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-191bb43a-4943-438a-a765-da4c726d25d2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:27.162190 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-191bb43a-4943-438a-a765-da4c726d25d2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:27.163232 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-191bb43a-4943-438a-a765-da4c726d25d2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:27.163669 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-191bb43a-4943-438a-a765-da4c726d25d2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:27.177195 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.wsgi [None req-191bb43a-4943-438a-a765-da4c726d25d2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] HTTP exception thrown: Instance ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 could not be found. Jan 24 09:25:27.177781 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-191bb43a-4943-438a-a765-da4c726d25d2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Returning 404 to user: Instance ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 could not be found. {{(pid=116863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:25:27.178633 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-191bb43a-4943-438a-a765-da4c726d25d2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9" status: 404 len: 111 microversion: 2.20 time: 0.029260 Jan 24 09:25:27.179163 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 578/1158] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:25:27 2022] GET /compute/v2.1/servers/ab1e93a3-324f-47fc-b6ef-173b16f4e6f9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 24 09:25:28.465994 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-221d77de-ef99-4877-85d4-3f21662a7444 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:25:28.466634 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-221d77de-ef99-4877-85d4-3f21662a7444 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:25:28.473339 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-221d77de-ef99-4877-85d4-3f21662a7444 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:28.473809 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-221d77de-ef99-4877-85d4-3f21662a7444 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:28.474683 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-221d77de-ef99-4877-85d4-3f21662a7444 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:28.475170 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-221d77de-ef99-4877-85d4-3f21662a7444 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:28.489455 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.wsgi [None req-221d77de-ef99-4877-85d4-3f21662a7444 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] HTTP exception thrown: Instance b820c156-179a-4172-a02b-6c88713087f1 could not be found. Jan 24 09:25:28.494237 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-221d77de-ef99-4877-85d4-3f21662a7444 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Returning 404 to user: Instance b820c156-179a-4172-a02b-6c88713087f1 could not be found. {{(pid=116864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:25:28.494237 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-221d77de-ef99-4877-85d4-3f21662a7444 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "DELETE /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 404 len: 111 microversion: 2.20 time: 0.028728 Jan 24 09:25:28.494237 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 581/1159] 10.222.0.113 () {60 vars in 1284 bytes} [Mon Jan 24 09:25:28 2022] DELETE /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 24 09:25:28.500349 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-e06af54c-5419-4720-b21d-36eb68792df2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:25:28.501424 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-e06af54c-5419-4720-b21d-36eb68792df2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] [instance: b820c156-179a-4172-a02b-6c88713087f1] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:25:28.507239 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e06af54c-5419-4720-b21d-36eb68792df2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:28.507696 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e06af54c-5419-4720-b21d-36eb68792df2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:28.508478 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e06af54c-5419-4720-b21d-36eb68792df2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:28.508960 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e06af54c-5419-4720-b21d-36eb68792df2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:28.522056 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.wsgi [None req-e06af54c-5419-4720-b21d-36eb68792df2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] HTTP exception thrown: Instance b820c156-179a-4172-a02b-6c88713087f1 could not be found. Jan 24 09:25:28.522678 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-e06af54c-5419-4720-b21d-36eb68792df2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] Returning 404 to user: Instance b820c156-179a-4172-a02b-6c88713087f1 could not be found. {{(pid=116863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:25:28.523502 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-e06af54c-5419-4720-b21d-36eb68792df2 tempest-AttachVolumeShelveTestJSON-839430541 tempest-AttachVolumeShelveTestJSON-839430541-project] 10.222.0.113 "GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1" status: 404 len: 111 microversion: 2.20 time: 0.027809 Jan 24 09:25:28.524275 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 579/1160] 10.222.0.113 () {60 vars in 1281 bytes} [Mon Jan 24 09:25:28 2022] GET /compute/v2.1/servers/b820c156-179a-4172-a02b-6c88713087f1 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 24 09:25:44.525304 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-5a43859d-a138-43ac-bcf6-da021c91e957 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:25:44.525816 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-5a43859d-a138-43ac-bcf6-da021c91e957 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] [instance: aace0c79-a7fc-4876-9a88-38057e742bbd] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:25:44.532211 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5a43859d-a138-43ac-bcf6-da021c91e957 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:44.532798 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5a43859d-a138-43ac-bcf6-da021c91e957 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:44.533480 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5a43859d-a138-43ac-bcf6-da021c91e957 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:44.533919 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5a43859d-a138-43ac-bcf6-da021c91e957 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:44.612757 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.objects.instance [None req-5a43859d-a138-43ac-bcf6-da021c91e957 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lazy-loading 'services' on Instance uuid aace0c79-a7fc-4876-9a88-38057e742bbd {{(pid=116864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 09:25:44.808348 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-5a43859d-a138-43ac-bcf6-da021c91e957 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] 10.222.0.113 "DELETE /compute/v2.1/servers/aace0c79-a7fc-4876-9a88-38057e742bbd/os-volume_attachments/c4ce33a6-b35e-46c1-882b-90d5c533f03b" status: 202 len: 0 microversion: 2.1 time: 0.286700 Jan 24 09:25:44.809220 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 582/1161] 10.222.0.113 () {58 vars in 1420 bytes} [Mon Jan 24 09:25:44 2022] DELETE /compute/v2.1/servers/aace0c79-a7fc-4876-9a88-38057e742bbd/os-volume_attachments/c4ce33a6-b35e-46c1-882b-90d5c533f03b => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:25:45.936993 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-ce6b733b-8f2b-44e5-9397-d36518ea41d6 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:25:45.937553 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-ce6b733b-8f2b-44e5-9397-d36518ea41d6 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] [instance: aace0c79-a7fc-4876-9a88-38057e742bbd] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:25:45.944710 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ce6b733b-8f2b-44e5-9397-d36518ea41d6 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:45.945164 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ce6b733b-8f2b-44e5-9397-d36518ea41d6 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:45.945953 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ce6b733b-8f2b-44e5-9397-d36518ea41d6 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:45.946428 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ce6b733b-8f2b-44e5-9397-d36518ea41d6 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:45.973817 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-ce6b733b-8f2b-44e5-9397-d36518ea41d6 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] [instance: aace0c79-a7fc-4876-9a88-38057e742bbd] Going to try to terminate instance {{(pid=116863) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 09:25:46.289147 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-ce6b733b-8f2b-44e5-9397-d36518ea41d6 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] 10.222.0.113 "DELETE /compute/v2.1/servers/aace0c79-a7fc-4876-9a88-38057e742bbd" status: 204 len: 0 microversion: 2.1 time: 0.355380 Jan 24 09:25:46.289549 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 580/1162] 10.222.0.113 () {58 vars in 1243 bytes} [Mon Jan 24 09:25:45 2022] DELETE /compute/v2.1/servers/aace0c79-a7fc-4876-9a88-38057e742bbd => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 24 09:25:46.298906 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-f4138d19-c245-4416-8aaa-190ac7a2e00c tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:25:46.299612 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-f4138d19-c245-4416-8aaa-190ac7a2e00c tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] [instance: aace0c79-a7fc-4876-9a88-38057e742bbd] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:25:46.306380 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f4138d19-c245-4416-8aaa-190ac7a2e00c tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:46.306823 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f4138d19-c245-4416-8aaa-190ac7a2e00c tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:46.307885 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f4138d19-c245-4416-8aaa-190ac7a2e00c tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:46.308108 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f4138d19-c245-4416-8aaa-190ac7a2e00c tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:46.452820 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-f4138d19-c245-4416-8aaa-190ac7a2e00c tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7dd4e5c6c9f467dab0d6b069d51b627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c949bc4951b4373b064a77e47c3dc8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:25:46.461130 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-f4138d19-c245-4416-8aaa-190ac7a2e00c tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] 10.222.0.113 "GET /compute/v2.1/servers/aace0c79-a7fc-4876-9a88-38057e742bbd" status: 200 len: 1519 microversion: 2.1 time: 0.166684 Jan 24 09:25:46.461755 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 583/1163] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:25:46 2022] GET /compute/v2.1/servers/aace0c79-a7fc-4876-9a88-38057e742bbd => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:25:47.480748 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-4002b8e5-6dab-424c-b0d7-944bcf4f4afe tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:25:47.481442 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-4002b8e5-6dab-424c-b0d7-944bcf4f4afe tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] [instance: aace0c79-a7fc-4876-9a88-38057e742bbd] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:25:47.488843 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4002b8e5-6dab-424c-b0d7-944bcf4f4afe tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:47.489287 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4002b8e5-6dab-424c-b0d7-944bcf4f4afe tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:47.490075 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4002b8e5-6dab-424c-b0d7-944bcf4f4afe tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:47.490692 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4002b8e5-6dab-424c-b0d7-944bcf4f4afe tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:47.646072 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-4002b8e5-6dab-424c-b0d7-944bcf4f4afe tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7dd4e5c6c9f467dab0d6b069d51b627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c949bc4951b4373b064a77e47c3dc8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:25:47.653438 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-4002b8e5-6dab-424c-b0d7-944bcf4f4afe tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] 10.222.0.113 "GET /compute/v2.1/servers/aace0c79-a7fc-4876-9a88-38057e742bbd" status: 200 len: 1519 microversion: 2.1 time: 0.176907 Jan 24 09:25:47.654007 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 581/1164] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:25:47 2022] GET /compute/v2.1/servers/aace0c79-a7fc-4876-9a88-38057e742bbd => generated 1519 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:25:48.673131 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-13492a1c-9311-4a35-a221-8b9c1e3e81d9 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:25:48.674469 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-13492a1c-9311-4a35-a221-8b9c1e3e81d9 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] [instance: aace0c79-a7fc-4876-9a88-38057e742bbd] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:25:48.681037 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-13492a1c-9311-4a35-a221-8b9c1e3e81d9 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:48.681440 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-13492a1c-9311-4a35-a221-8b9c1e3e81d9 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:48.682456 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-13492a1c-9311-4a35-a221-8b9c1e3e81d9 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:48.683061 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-13492a1c-9311-4a35-a221-8b9c1e3e81d9 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:48.837126 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-13492a1c-9311-4a35-a221-8b9c1e3e81d9 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7dd4e5c6c9f467dab0d6b069d51b627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c949bc4951b4373b064a77e47c3dc8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:25:48.855049 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-13492a1c-9311-4a35-a221-8b9c1e3e81d9 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] 10.222.0.113 "GET /compute/v2.1/servers/aace0c79-a7fc-4876-9a88-38057e742bbd" status: 200 len: 1519 microversion: 2.1 time: 0.187054 Jan 24 09:25:48.855645 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 584/1165] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:25:48 2022] GET /compute/v2.1/servers/aace0c79-a7fc-4876-9a88-38057e742bbd => generated 1519 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:25:48.900009 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [req-177d0f4b-e3c9-455c-bc0e-78b6de7d441c req-274506c8-4915-4e3b-865b-665b6149d113 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aace0c79-a7fc-4876-9a88-38057e742bbd", "name": "network-vif-deleted", "tag": "c011af7c-0d62-46b5-a07e-00ca69f678b2"}]} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:25:48.901559 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:25:48.901559 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: warnings.warn(msg) Jan 24 09:25:48.909807 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-177d0f4b-e3c9-455c-bc0e-78b6de7d441c req-274506c8-4915-4e3b-865b-665b6149d113 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:48.910283 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-177d0f4b-e3c9-455c-bc0e-78b6de7d441c req-274506c8-4915-4e3b-865b-665b6149d113 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:48.921466 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.compute.server_external_events [req-177d0f4b-e3c9-455c-bc0e-78b6de7d441c req-274506c8-4915-4e3b-865b-665b6149d113 service nova] Creating event network-vif-deleted:c011af7c-0d62-46b5-a07e-00ca69f678b2 for instance aace0c79-a7fc-4876-9a88-38057e742bbd on hv-cinder-80403 Jan 24 09:25:48.927300 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [req-177d0f4b-e3c9-455c-bc0e-78b6de7d441c req-274506c8-4915-4e3b-865b-665b6149d113 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031132 Jan 24 09:25:48.927977 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 582/1166] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:25:49.873209 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-da0d5d45-62bb-4b24-87e3-b26abe811477 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:25:49.873818 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-da0d5d45-62bb-4b24-87e3-b26abe811477 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] [instance: aace0c79-a7fc-4876-9a88-38057e742bbd] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:25:49.881329 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-da0d5d45-62bb-4b24-87e3-b26abe811477 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:49.889415 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-da0d5d45-62bb-4b24-87e3-b26abe811477 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:49.889415 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-da0d5d45-62bb-4b24-87e3-b26abe811477 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:49.889415 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-da0d5d45-62bb-4b24-87e3-b26abe811477 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:49.917748 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-da0d5d45-62bb-4b24-87e3-b26abe811477 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:49.918225 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-da0d5d45-62bb-4b24-87e3-b26abe811477 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:49.918682 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.objects.instance [None req-da0d5d45-62bb-4b24-87e3-b26abe811477 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lazy-loading 'fault' on Instance uuid aace0c79-a7fc-4876-9a88-38057e742bbd {{(pid=116864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 09:25:49.968849 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-da0d5d45-62bb-4b24-87e3-b26abe811477 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7dd4e5c6c9f467dab0d6b069d51b627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c949bc4951b4373b064a77e47c3dc8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:25:49.976849 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-da0d5d45-62bb-4b24-87e3-b26abe811477 tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] 10.222.0.113 "GET /compute/v2.1/servers/aace0c79-a7fc-4876-9a88-38057e742bbd" status: 200 len: 1313 microversion: 2.1 time: 0.107174 Jan 24 09:25:49.977596 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 585/1167] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:25:49 2022] GET /compute/v2.1/servers/aace0c79-a7fc-4876-9a88-38057e742bbd => generated 1313 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:25:51.001260 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-27d6538a-7afc-43dd-9991-0477c51d14ad tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:25:51.001972 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-27d6538a-7afc-43dd-9991-0477c51d14ad tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] [instance: aace0c79-a7fc-4876-9a88-38057e742bbd] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:25:51.009049 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-27d6538a-7afc-43dd-9991-0477c51d14ad tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:51.009514 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-27d6538a-7afc-43dd-9991-0477c51d14ad tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:51.010348 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-27d6538a-7afc-43dd-9991-0477c51d14ad tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:25:51.010792 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-27d6538a-7afc-43dd-9991-0477c51d14ad tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:25:51.025324 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.wsgi [None req-27d6538a-7afc-43dd-9991-0477c51d14ad tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] HTTP exception thrown: Instance aace0c79-a7fc-4876-9a88-38057e742bbd could not be found. Jan 24 09:25:51.025966 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-27d6538a-7afc-43dd-9991-0477c51d14ad tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] Returning 404 to user: Instance aace0c79-a7fc-4876-9a88-38057e742bbd could not be found. {{(pid=116863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:25:51.033656 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-27d6538a-7afc-43dd-9991-0477c51d14ad tempest-VolumesSnapshotTestJSON-1312806945 tempest-VolumesSnapshotTestJSON-1312806945-project] 10.222.0.113 "GET /compute/v2.1/servers/aace0c79-a7fc-4876-9a88-38057e742bbd" status: 404 len: 111 microversion: 2.1 time: 0.031925 Jan 24 09:25:51.033656 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 583/1168] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:25:50 2022] GET /compute/v2.1/servers/aace0c79-a7fc-4876-9a88-38057e742bbd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 09:25:52.018733 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 24 09:25:52.019337 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: Mon Jan 24 09:25:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 24 09:26:06.591050 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-66a98683-003c-4a40-8a3b-283561b33233 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1889951169", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-760537949", "security_groups": [{"name": "tempest-secgroup-smoke-1899158498"}], "block_device_mapping_v2": [{"uuid": "0935c15b-b0d8-4b88-a441-939eedcfffc7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "bb18b00a-6e74-4475-8741-4c8ca85a032a"}]}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:26:07.064211 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.network.neutron [None req-66a98683-003c-4a40-8a3b-283561b33233 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] validate_networks() for [('bb18b00a-6e74-4475-8741-4c8ca85a032a', None, None, None, None, None)] {{(pid=116864) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 09:26:07.435796 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-66a98683-003c-4a40-8a3b-283561b33233 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Flavor limits 0:0:0 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 09:26:07.436194 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-66a98683-003c-4a40-8a3b-283561b33233 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Image limits 0:0:0 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 09:26:07.436668 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-66a98683-003c-4a40-8a3b-283561b33233 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Flavor pref 0:0:0 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 09:26:07.437075 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-66a98683-003c-4a40-8a3b-283561b33233 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Image pref 0:0:0 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 09:26:07.437701 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-66a98683-003c-4a40-8a3b-283561b33233 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 09:26:07.447571 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-66a98683-003c-4a40-8a3b-283561b33233 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:26:07.448027 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-66a98683-003c-4a40-8a3b-283561b33233 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:26:07.448835 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-66a98683-003c-4a40-8a3b-283561b33233 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:26:07.449279 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-66a98683-003c-4a40-8a3b-283561b33233 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:26:07.467226 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.quota [None req-66a98683-003c-4a40-8a3b-283561b33233 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Getting quotas for project bedaa9b436ab45108aa33633b17e58d0. Resources: {'ram', 'cores', 'instances'} {{(pid=116864) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 09:26:07.471866 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.quota [None req-66a98683-003c-4a40-8a3b-283561b33233 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Getting quotas for user 91399ccc8ba64dc7becff56785e9b904 and project bedaa9b436ab45108aa33633b17e58d0. Resources: {'ram', 'cores', 'instances'} {{(pid=116864) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 09:26:07.531455 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-66a98683-003c-4a40-8a3b-283561b33233 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Going to run 1 instances... {{(pid=116864) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 09:26:07.533953 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-66a98683-003c-4a40-8a3b-283561b33233 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: 4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0935c15b-b0d8-4b88-a441-939eedcfffc7',volume_size=None,volume_type=None)] {{(pid=116864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 09:26:07.886544 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-66a98683-003c-4a40-8a3b-283561b33233 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.298721 Jan 24 09:26:07.891091 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 586/1169] 10.222.0.113 () {60 vars in 1151 bytes} [Mon Jan 24 09:26:06 2022] POST /compute/v2.1/servers => generated 408 bytes in 1304 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 24 09:26:07.897361 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-4c8be198-c675-4004-9bb1-80c28cda0401 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:26:07.898696 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-4c8be198-c675-4004-9bb1-80c28cda0401 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: 4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:26:07.957512 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-4c8be198-c675-4004-9bb1-80c28cda0401 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:26:07.964716 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-4c8be198-c675-4004-9bb1-80c28cda0401 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89" status: 200 len: 1097 microversion: 2.1 time: 0.071243 Jan 24 09:26:07.965278 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 584/1170] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:26:07 2022] GET /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89 => generated 1097 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:26:08.982877 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-3cf8602b-ce50-4a42-9b21-d18230222b2a tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:26:08.983635 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-3cf8602b-ce50-4a42-9b21-d18230222b2a tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: 4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:26:08.991256 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3cf8602b-ce50-4a42-9b21-d18230222b2a tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:26:08.991651 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3cf8602b-ce50-4a42-9b21-d18230222b2a tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:26:08.992445 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3cf8602b-ce50-4a42-9b21-d18230222b2a tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:26:08.992886 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3cf8602b-ce50-4a42-9b21-d18230222b2a tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:26:09.069558 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-3cf8602b-ce50-4a42-9b21-d18230222b2a tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:26:09.071687 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-3cf8602b-ce50-4a42-9b21-d18230222b2a tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89" status: 200 len: 1147 microversion: 2.1 time: 0.093104 Jan 24 09:26:09.072201 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 587/1171] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:26:08 2022] GET /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89 => generated 1147 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:26:10.088443 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-84e91485-ad20-417e-9b1b-4dff27a72705 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:26:10.091480 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-84e91485-ad20-417e-9b1b-4dff27a72705 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: 4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:26:10.096606 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-84e91485-ad20-417e-9b1b-4dff27a72705 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:26:10.097020 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-84e91485-ad20-417e-9b1b-4dff27a72705 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:26:10.098352 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-84e91485-ad20-417e-9b1b-4dff27a72705 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:26:10.098991 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-84e91485-ad20-417e-9b1b-4dff27a72705 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:26:10.192041 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-84e91485-ad20-417e-9b1b-4dff27a72705 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:26:10.205193 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-84e91485-ad20-417e-9b1b-4dff27a72705 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89" status: 200 len: 1203 microversion: 2.1 time: 0.120117 Jan 24 09:26:10.206655 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 585/1172] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:26:10 2022] GET /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89 => generated 1203 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:26:11.233637 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-824caefd-8cb2-4db4-8e52-352a2f9c6782 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:26:11.234809 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-824caefd-8cb2-4db4-8e52-352a2f9c6782 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: 4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:26:11.245200 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-824caefd-8cb2-4db4-8e52-352a2f9c6782 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:26:11.245646 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-824caefd-8cb2-4db4-8e52-352a2f9c6782 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:26:11.246466 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-824caefd-8cb2-4db4-8e52-352a2f9c6782 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:26:11.246900 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-824caefd-8cb2-4db4-8e52-352a2f9c6782 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:26:11.460933 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-824caefd-8cb2-4db4-8e52-352a2f9c6782 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:26:11.468717 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-824caefd-8cb2-4db4-8e52-352a2f9c6782 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89" status: 200 len: 1281 microversion: 2.1 time: 0.241332 Jan 24 09:26:11.469565 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 588/1173] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:26:11 2022] GET /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89 => generated 1281 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:26:12.487046 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-01cca8f7-95b4-4cb1-bdbf-f58cb3f315fe tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:26:12.487597 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-01cca8f7-95b4-4cb1-bdbf-f58cb3f315fe tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: 4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:26:12.493874 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-01cca8f7-95b4-4cb1-bdbf-f58cb3f315fe tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:26:12.494373 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-01cca8f7-95b4-4cb1-bdbf-f58cb3f315fe tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:26:12.495160 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-01cca8f7-95b4-4cb1-bdbf-f58cb3f315fe tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:26:12.495601 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-01cca8f7-95b4-4cb1-bdbf-f58cb3f315fe tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:26:12.684500 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-01cca8f7-95b4-4cb1-bdbf-f58cb3f315fe tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:26:12.692593 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-01cca8f7-95b4-4cb1-bdbf-f58cb3f315fe tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89" status: 200 len: 1281 microversion: 2.1 time: 0.209340 Jan 24 09:26:12.693176 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 586/1174] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:26:12 2022] GET /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89 => generated 1281 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:26:13.422367 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [req-98f34070-5d1a-484e-a5ad-6194c23892b1 req-32162e2b-ae09-4b74-8a11-7b961223cfb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89", "tag": "3c096b5a-bed1-485d-924a-31c2ba638b87"}]} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:26:13.424226 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:26:13.424226 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: warnings.warn(msg) Jan 24 09:26:13.431992 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-98f34070-5d1a-484e-a5ad-6194c23892b1 req-32162e2b-ae09-4b74-8a11-7b961223cfb1 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:26:13.432439 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-98f34070-5d1a-484e-a5ad-6194c23892b1 req-32162e2b-ae09-4b74-8a11-7b961223cfb1 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:26:13.448775 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.compute.server_external_events [req-98f34070-5d1a-484e-a5ad-6194c23892b1 req-32162e2b-ae09-4b74-8a11-7b961223cfb1 service nova] Creating event network-changed:3c096b5a-bed1-485d-924a-31c2ba638b87 for instance 4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89 on hv-cinder-80403 Jan 24 09:26:13.453776 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [req-98f34070-5d1a-484e-a5ad-6194c23892b1 req-32162e2b-ae09-4b74-8a11-7b961223cfb1 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035030 Jan 24 09:26:13.454450 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 589/1175] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 09:26:13.714129 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-d51a4f1a-7a07-46ff-bb1b-0698f0854d38 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:26:13.715258 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-d51a4f1a-7a07-46ff-bb1b-0698f0854d38 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: 4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:26:13.727188 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d51a4f1a-7a07-46ff-bb1b-0698f0854d38 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:26:13.727188 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d51a4f1a-7a07-46ff-bb1b-0698f0854d38 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:26:13.727188 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d51a4f1a-7a07-46ff-bb1b-0698f0854d38 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:26:13.727188 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d51a4f1a-7a07-46ff-bb1b-0698f0854d38 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:26:13.949221 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-d51a4f1a-7a07-46ff-bb1b-0698f0854d38 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:26:13.963630 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-d51a4f1a-7a07-46ff-bb1b-0698f0854d38 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89" status: 200 len: 1281 microversion: 2.1 time: 0.258655 Jan 24 09:26:13.964379 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 587/1176] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:26:13 2022] GET /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89 => generated 1281 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:26:14.981677 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-201c4771-c6de-4de1-ad1a-23e3633b6ddf tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:26:14.982570 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-201c4771-c6de-4de1-ad1a-23e3633b6ddf tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: 4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:26:14.989121 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-201c4771-c6de-4de1-ad1a-23e3633b6ddf tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:26:14.989874 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-201c4771-c6de-4de1-ad1a-23e3633b6ddf tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:26:14.990382 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-201c4771-c6de-4de1-ad1a-23e3633b6ddf tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:26:14.990830 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-201c4771-c6de-4de1-ad1a-23e3633b6ddf tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:26:15.134148 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-201c4771-c6de-4de1-ad1a-23e3633b6ddf tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:26:15.141894 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-201c4771-c6de-4de1-ad1a-23e3633b6ddf tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89" status: 200 len: 1281 microversion: 2.1 time: 0.164702 Jan 24 09:26:15.142734 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 590/1177] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:26:14 2022] GET /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89 => generated 1281 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:26:16.158657 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-4cdd906c-a9fb-41b0-a2da-91d03fef4a3b tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:26:16.159309 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-4cdd906c-a9fb-41b0-a2da-91d03fef4a3b tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: 4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:26:16.169348 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4cdd906c-a9fb-41b0-a2da-91d03fef4a3b tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:26:16.169801 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4cdd906c-a9fb-41b0-a2da-91d03fef4a3b tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:26:16.170657 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4cdd906c-a9fb-41b0-a2da-91d03fef4a3b tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:26:16.171086 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4cdd906c-a9fb-41b0-a2da-91d03fef4a3b tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:26:16.346583 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-4cdd906c-a9fb-41b0-a2da-91d03fef4a3b tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:26:16.357437 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-4cdd906c-a9fb-41b0-a2da-91d03fef4a3b tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89" status: 200 len: 1269 microversion: 2.1 time: 0.199903 Jan 24 09:26:16.357437 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 588/1178] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:26:16 2022] GET /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89 => generated 1269 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:26:17.373035 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-914c3fff-9531-4aa0-a6e5-0b0d9fafec45 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:26:17.373649 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-914c3fff-9531-4aa0-a6e5-0b0d9fafec45 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: 4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:26:17.381120 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-914c3fff-9531-4aa0-a6e5-0b0d9fafec45 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:26:17.381572 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-914c3fff-9531-4aa0-a6e5-0b0d9fafec45 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:26:17.382585 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-914c3fff-9531-4aa0-a6e5-0b0d9fafec45 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:26:17.383194 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-914c3fff-9531-4aa0-a6e5-0b0d9fafec45 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:26:17.523312 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-914c3fff-9531-4aa0-a6e5-0b0d9fafec45 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:26:17.530538 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-914c3fff-9531-4aa0-a6e5-0b0d9fafec45 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89" status: 200 len: 1269 microversion: 2.1 time: 0.161210 Jan 24 09:26:17.531112 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 591/1179] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:26:17 2022] GET /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89 => generated 1269 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:26:18.548733 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-b9bce6e7-bbe7-4f26-bc0f-4507b793a826 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:26:18.549308 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-b9bce6e7-bbe7-4f26-bc0f-4507b793a826 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: 4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:26:18.556236 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b9bce6e7-bbe7-4f26-bc0f-4507b793a826 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:26:18.556687 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b9bce6e7-bbe7-4f26-bc0f-4507b793a826 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:26:18.557593 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b9bce6e7-bbe7-4f26-bc0f-4507b793a826 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:26:18.558047 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b9bce6e7-bbe7-4f26-bc0f-4507b793a826 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:26:18.704314 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-b9bce6e7-bbe7-4f26-bc0f-4507b793a826 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:26:18.711725 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-b9bce6e7-bbe7-4f26-bc0f-4507b793a826 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89" status: 200 len: 1269 microversion: 2.1 time: 0.167025 Jan 24 09:26:18.712301 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 589/1180] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:26:18 2022] GET /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89 => generated 1269 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:26:19.727345 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-6a18da44-a8d5-499f-84e8-37f8c58e880d tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:26:19.727960 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-6a18da44-a8d5-499f-84e8-37f8c58e880d tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: 4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:26:19.734176 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6a18da44-a8d5-499f-84e8-37f8c58e880d tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:26:19.734637 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6a18da44-a8d5-499f-84e8-37f8c58e880d tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:26:19.735425 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6a18da44-a8d5-499f-84e8-37f8c58e880d tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:26:19.735874 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6a18da44-a8d5-499f-84e8-37f8c58e880d tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:26:19.891444 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-6a18da44-a8d5-499f-84e8-37f8c58e880d tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:26:19.900011 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-6a18da44-a8d5-499f-84e8-37f8c58e880d tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89" status: 200 len: 1269 microversion: 2.1 time: 0.176262 Jan 24 09:26:19.908278 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 592/1181] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:26:19 2022] GET /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89 => generated 1269 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:26:20.916249 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-3ce91fe1-72b0-4c50-9510-9b02aa9c51f0 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:26:20.916861 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-3ce91fe1-72b0-4c50-9510-9b02aa9c51f0 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: 4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:26:20.923349 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3ce91fe1-72b0-4c50-9510-9b02aa9c51f0 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:26:20.923891 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3ce91fe1-72b0-4c50-9510-9b02aa9c51f0 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:26:20.924690 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3ce91fe1-72b0-4c50-9510-9b02aa9c51f0 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:26:20.925204 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3ce91fe1-72b0-4c50-9510-9b02aa9c51f0 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:26:21.085592 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-3ce91fe1-72b0-4c50-9510-9b02aa9c51f0 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:26:21.093045 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-3ce91fe1-72b0-4c50-9510-9b02aa9c51f0 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89" status: 200 len: 1269 microversion: 2.1 time: 0.180461 Jan 24 09:26:21.093618 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 590/1182] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:26:20 2022] GET /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89 => generated 1269 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:26:22.110191 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-216cba2b-90fa-4c28-9a01-b42be3eaab75 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:26:22.110787 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-216cba2b-90fa-4c28-9a01-b42be3eaab75 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: 4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:26:22.117712 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-216cba2b-90fa-4c28-9a01-b42be3eaab75 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:26:22.118230 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-216cba2b-90fa-4c28-9a01-b42be3eaab75 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:26:22.119012 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-216cba2b-90fa-4c28-9a01-b42be3eaab75 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:26:22.119448 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-216cba2b-90fa-4c28-9a01-b42be3eaab75 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:26:22.263330 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-216cba2b-90fa-4c28-9a01-b42be3eaab75 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:26:22.272011 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-216cba2b-90fa-4c28-9a01-b42be3eaab75 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89" status: 200 len: 1269 microversion: 2.1 time: 0.165469 Jan 24 09:26:22.272717 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 593/1183] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:26:22 2022] GET /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89 => generated 1269 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:26:23.288980 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-ddd0cafb-36a2-46d5-8e26-be90cd839205 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:26:23.289620 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-ddd0cafb-36a2-46d5-8e26-be90cd839205 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: 4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:26:23.296135 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ddd0cafb-36a2-46d5-8e26-be90cd839205 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:26:23.296590 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ddd0cafb-36a2-46d5-8e26-be90cd839205 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:26:23.297382 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ddd0cafb-36a2-46d5-8e26-be90cd839205 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:26:23.297819 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ddd0cafb-36a2-46d5-8e26-be90cd839205 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:26:23.450294 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-ddd0cafb-36a2-46d5-8e26-be90cd839205 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:26:23.457883 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-ddd0cafb-36a2-46d5-8e26-be90cd839205 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89" status: 200 len: 1269 microversion: 2.1 time: 0.172965 Jan 24 09:26:23.458483 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 591/1184] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:26:23 2022] GET /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89 => generated 1269 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:26:24.475615 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-2d7ce6be-c63b-4fac-b994-01c6a05a9cc0 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:26:24.476263 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-2d7ce6be-c63b-4fac-b994-01c6a05a9cc0 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: 4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:26:24.482612 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2d7ce6be-c63b-4fac-b994-01c6a05a9cc0 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:26:24.483066 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2d7ce6be-c63b-4fac-b994-01c6a05a9cc0 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:26:24.483848 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2d7ce6be-c63b-4fac-b994-01c6a05a9cc0 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:26:24.484320 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2d7ce6be-c63b-4fac-b994-01c6a05a9cc0 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:26:24.622481 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-2d7ce6be-c63b-4fac-b994-01c6a05a9cc0 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:26:24.630347 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-2d7ce6be-c63b-4fac-b994-01c6a05a9cc0 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89" status: 200 len: 1269 microversion: 2.1 time: 0.159308 Jan 24 09:26:24.631199 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 594/1185] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:26:24 2022] GET /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89 => generated 1269 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:26:25.647618 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-980046ab-2f0c-4c96-a627-38430d71f275 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:26:25.648236 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-980046ab-2f0c-4c96-a627-38430d71f275 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: 4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:26:25.654796 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-980046ab-2f0c-4c96-a627-38430d71f275 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:26:25.657760 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-980046ab-2f0c-4c96-a627-38430d71f275 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:26:25.657760 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-980046ab-2f0c-4c96-a627-38430d71f275 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:26:25.657760 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-980046ab-2f0c-4c96-a627-38430d71f275 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:26:25.807605 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-980046ab-2f0c-4c96-a627-38430d71f275 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:26:25.815723 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-980046ab-2f0c-4c96-a627-38430d71f275 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89" status: 200 len: 1269 microversion: 2.1 time: 0.172059 Jan 24 09:26:25.815723 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 592/1186] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:26:25 2022] GET /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89 => generated 1269 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:26:26.833213 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-bad285c3-bf84-4d85-899d-328d17da1537 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:26:26.833824 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-bad285c3-bf84-4d85-899d-328d17da1537 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: 4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:26:26.839795 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-bad285c3-bf84-4d85-899d-328d17da1537 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:26:26.840248 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-bad285c3-bf84-4d85-899d-328d17da1537 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:26:26.841036 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-bad285c3-bf84-4d85-899d-328d17da1537 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:26:26.841475 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-bad285c3-bf84-4d85-899d-328d17da1537 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:26:26.976237 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-bad285c3-bf84-4d85-899d-328d17da1537 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:26:26.983657 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-bad285c3-bf84-4d85-899d-328d17da1537 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89" status: 200 len: 1269 microversion: 2.1 time: 0.154615 Jan 24 09:26:26.988427 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 595/1187] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:26:26 2022] GET /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89 => generated 1269 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:26:27.993287 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [req-0e052f54-7377-4753-a544-86e6536fd16a req-1889bcc8-fb20-4db9-989f-2978c1e6f885 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89", "name": "network-vif-plugged", "status": "completed", "tag": "3c096b5a-bed1-485d-924a-31c2ba638b87"}]} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:26:27.995795 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:26:27.995795 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: warnings.warn(msg) Jan 24 09:26:28.002003 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-959888be-95ec-4e0d-9e01-d94128d82d82 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:26:28.003738 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-0e052f54-7377-4753-a544-86e6536fd16a req-1889bcc8-fb20-4db9-989f-2978c1e6f885 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:26:28.003944 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-959888be-95ec-4e0d-9e01-d94128d82d82 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: 4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:26:28.004195 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-0e052f54-7377-4753-a544-86e6536fd16a req-1889bcc8-fb20-4db9-989f-2978c1e6f885 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:26:28.010646 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-959888be-95ec-4e0d-9e01-d94128d82d82 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:26:28.011108 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-959888be-95ec-4e0d-9e01-d94128d82d82 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:26:28.011906 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-959888be-95ec-4e0d-9e01-d94128d82d82 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:26:28.012350 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-959888be-95ec-4e0d-9e01-d94128d82d82 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:26:28.015436 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.compute.server_external_events [req-0e052f54-7377-4753-a544-86e6536fd16a req-1889bcc8-fb20-4db9-989f-2978c1e6f885 service nova] Creating event network-vif-plugged:3c096b5a-bed1-485d-924a-31c2ba638b87 for instance 4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89 on hv-cinder-80403 Jan 24 09:26:28.020564 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [req-0e052f54-7377-4753-a544-86e6536fd16a req-1889bcc8-fb20-4db9-989f-2978c1e6f885 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031714 Jan 24 09:26:28.021224 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 593/1188] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:26:28.166447 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-959888be-95ec-4e0d-9e01-d94128d82d82 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:26:28.175442 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-959888be-95ec-4e0d-9e01-d94128d82d82 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89" status: 200 len: 1269 microversion: 2.1 time: 0.177932 Jan 24 09:26:28.176340 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 596/1189] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:26:27 2022] GET /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89 => generated 1269 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:26:29.193904 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-3475d07e-485f-4e15-a44b-3227829db305 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:26:29.194637 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-3475d07e-485f-4e15-a44b-3227829db305 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: 4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:26:29.200700 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3475d07e-485f-4e15-a44b-3227829db305 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:26:29.211147 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3475d07e-485f-4e15-a44b-3227829db305 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:26:29.211147 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3475d07e-485f-4e15-a44b-3227829db305 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:26:29.211147 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3475d07e-485f-4e15-a44b-3227829db305 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:26:29.399049 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-3475d07e-485f-4e15-a44b-3227829db305 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:26:29.406401 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-3475d07e-485f-4e15-a44b-3227829db305 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89" status: 200 len: 1269 microversion: 2.1 time: 0.217440 Jan 24 09:26:29.406912 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 594/1190] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:26:29 2022] GET /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89 => generated 1269 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:26:30.424769 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-d224f326-6aa9-4f8f-9d56-da650ed18298 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:26:30.425611 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-d224f326-6aa9-4f8f-9d56-da650ed18298 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: 4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:26:30.432648 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d224f326-6aa9-4f8f-9d56-da650ed18298 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:26:30.433241 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d224f326-6aa9-4f8f-9d56-da650ed18298 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:26:30.434039 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d224f326-6aa9-4f8f-9d56-da650ed18298 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:26:30.434507 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d224f326-6aa9-4f8f-9d56-da650ed18298 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:26:30.645373 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-d224f326-6aa9-4f8f-9d56-da650ed18298 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:26:30.653411 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-d224f326-6aa9-4f8f-9d56-da650ed18298 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89" status: 200 len: 1456 microversion: 2.1 time: 0.233048 Jan 24 09:26:30.655063 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 597/1191] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:26:30 2022] GET /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89 => generated 1456 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:26:30.670360 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-d9247cfb-8378-40fe-b906-ab52b5f49197 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:26:30.671147 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-d9247cfb-8378-40fe-b906-ab52b5f49197 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: 4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:26:30.678904 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d9247cfb-8378-40fe-b906-ab52b5f49197 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:26:30.681410 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d9247cfb-8378-40fe-b906-ab52b5f49197 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:26:30.681410 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d9247cfb-8378-40fe-b906-ab52b5f49197 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:26:30.681410 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d9247cfb-8378-40fe-b906-ab52b5f49197 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:26:30.830666 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-d9247cfb-8378-40fe-b906-ab52b5f49197 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:26:30.845440 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-d9247cfb-8378-40fe-b906-ab52b5f49197 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89" status: 200 len: 1456 microversion: 2.1 time: 0.172845 Jan 24 09:26:30.845440 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 595/1192] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:26:30 2022] GET /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89 => generated 1456 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:26:33.876454 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [req-91f097fe-6868-404a-8dfd-64701ee7e843 req-9ff454a4-cd80-40be-bc56-d8c9f75028c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89", "tag": "3c096b5a-bed1-485d-924a-31c2ba638b87"}]} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:26:33.879260 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:26:33.879260 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: warnings.warn(msg) Jan 24 09:26:33.888564 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-91f097fe-6868-404a-8dfd-64701ee7e843 req-9ff454a4-cd80-40be-bc56-d8c9f75028c9 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:26:33.889001 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-91f097fe-6868-404a-8dfd-64701ee7e843 req-9ff454a4-cd80-40be-bc56-d8c9f75028c9 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:26:33.901808 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.compute.server_external_events [req-91f097fe-6868-404a-8dfd-64701ee7e843 req-9ff454a4-cd80-40be-bc56-d8c9f75028c9 service nova] Creating event network-changed:3c096b5a-bed1-485d-924a-31c2ba638b87 for instance 4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89 on hv-cinder-80403 Jan 24 09:26:33.912373 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [req-91f097fe-6868-404a-8dfd-64701ee7e843 req-9ff454a4-cd80-40be-bc56-d8c9f75028c9 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039680 Jan 24 09:26:33.913001 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 598/1193] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:26:47.602038 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-9499addb-d01f-44d6-b049-4c07f5844868 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Action: 'create', calling method: .version_select at 0x7f473ddb80d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-755176761"}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:26:47.618685 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.quota [None req-9499addb-d01f-44d6-b049-4c07f5844868 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Getting quotas for project 7a1db64ecaea44e09ecbf80f34523511. Resources: {'key_pairs'} {{(pid=116863) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 09:26:47.622557 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.quota [None req-9499addb-d01f-44d6-b049-4c07f5844868 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Getting quotas for user d628baac6cf64ce384d85eb0375b4c99 and project 7a1db64ecaea44e09ecbf80f34523511. Resources: {'key_pairs'} {{(pid=116863) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 09:26:48.561690 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.quota [None req-9499addb-d01f-44d6-b049-4c07f5844868 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Getting quotas for project 7a1db64ecaea44e09ecbf80f34523511. Resources: {'key_pairs'} {{(pid=116863) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 09:26:48.567457 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.quota [None req-9499addb-d01f-44d6-b049-4c07f5844868 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Getting quotas for user d628baac6cf64ce384d85eb0375b4c99 and project 7a1db64ecaea44e09ecbf80f34523511. Resources: {'key_pairs'} {{(pid=116863) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 09:26:48.582394 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-9499addb-d01f-44d6-b049-4c07f5844868 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 1.248030 Jan 24 09:26:48.583435 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 596/1194] 10.222.0.113 () {60 vars in 1162 bytes} [Mon Jan 24 09:26:47 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:27:10.717254 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-8ff16478-51e4-4d4d-9165-aa195ecffc19 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-22105726", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-755176761", "security_groups": [{"name": "tempest-secgroup-smoke-1637708309"}], "networks": [{"uuid": "f1b3ddc8-9c98-4b8a-9bfd-6aac403b9e78"}], "block_device_mapping_v2": [{"uuid": "dc23ef9c-6097-4bbe-9c6f-8f20c3fb67ed", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:27:11.127654 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.network.neutron [None req-8ff16478-51e4-4d4d-9165-aa195ecffc19 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] validate_networks() for [('f1b3ddc8-9c98-4b8a-9bfd-6aac403b9e78', None, None, None, None, None)] {{(pid=116864) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 09:27:11.560484 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-8ff16478-51e4-4d4d-9165-aa195ecffc19 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Flavor limits 0:0:0 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 09:27:11.560932 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-8ff16478-51e4-4d4d-9165-aa195ecffc19 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Image limits 0:0:0 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 09:27:11.561567 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-8ff16478-51e4-4d4d-9165-aa195ecffc19 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Flavor pref 0:0:0 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 09:27:11.561982 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-8ff16478-51e4-4d4d-9165-aa195ecffc19 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Image pref 0:0:0 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 09:27:11.562421 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.virt.hardware [None req-8ff16478-51e4-4d4d-9165-aa195ecffc19 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 09:27:11.573408 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-8ff16478-51e4-4d4d-9165-aa195ecffc19 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:11.573961 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-8ff16478-51e4-4d4d-9165-aa195ecffc19 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:11.574949 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-8ff16478-51e4-4d4d-9165-aa195ecffc19 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:11.575427 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-8ff16478-51e4-4d4d-9165-aa195ecffc19 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:11.606909 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.quota [None req-8ff16478-51e4-4d4d-9165-aa195ecffc19 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Getting quotas for project 7a1db64ecaea44e09ecbf80f34523511. Resources: {'ram', 'cores', 'instances'} {{(pid=116864) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 09:27:11.615019 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.quota [None req-8ff16478-51e4-4d4d-9165-aa195ecffc19 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Getting quotas for user d628baac6cf64ce384d85eb0375b4c99 and project 7a1db64ecaea44e09ecbf80f34523511. Resources: {'ram', 'cores', 'instances'} {{(pid=116864) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 09:27:11.675067 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-8ff16478-51e4-4d4d-9165-aa195ecffc19 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Going to run 1 instances... {{(pid=116864) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 09:27:11.678372 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-8ff16478-51e4-4d4d-9165-aa195ecffc19 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dc23ef9c-6097-4bbe-9c6f-8f20c3fb67ed',volume_size=None,volume_type=None)] {{(pid=116864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 09:27:12.163228 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 24 09:27:12.163931 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: Mon Jan 24 09:27:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 24 09:27:12.273956 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-8ff16478-51e4-4d4d-9165-aa195ecffc19 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.561099 Jan 24 09:27:12.279737 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 599/1195] 10.222.0.113 () {60 vars in 1151 bytes} [Mon Jan 24 09:27:10 2022] POST /compute/v2.1/servers => generated 408 bytes in 1568 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 24 09:27:12.290725 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-3443fe83-41d1-41a0-b9c0-56e2527b94d1 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:27:12.291341 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-3443fe83-41d1-41a0-b9c0-56e2527b94d1 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:27:12.574743 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-3443fe83-41d1-41a0-b9c0-56e2527b94d1 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd628baac6cf64ce384d85eb0375b4c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1db64ecaea44e09ecbf80f34523511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:27:12.580602 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-3443fe83-41d1-41a0-b9c0-56e2527b94d1 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf" status: 200 len: 1089 microversion: 2.1 time: 0.293971 Jan 24 09:27:12.583736 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 597/1196] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:27:12 2022] GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf => generated 1089 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:27:13.599169 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-4f4fb902-7b08-42f5-a4fb-35623b0e2407 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:27:13.599923 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-4f4fb902-7b08-42f5-a4fb-35623b0e2407 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:27:13.921996 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-4f4fb902-7b08-42f5-a4fb-35623b0e2407 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd628baac6cf64ce384d85eb0375b4c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1db64ecaea44e09ecbf80f34523511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:27:13.930118 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-4f4fb902-7b08-42f5-a4fb-35623b0e2407 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf" status: 200 len: 1089 microversion: 2.1 time: 0.335238 Jan 24 09:27:13.930718 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 600/1197] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:27:13 2022] GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf => generated 1089 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:27:14.947164 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-8f0bfd42-d625-4d26-96a4-10d618639c44 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:27:14.947783 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-8f0bfd42-d625-4d26-96a4-10d618639c44 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:27:14.954828 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8f0bfd42-d625-4d26-96a4-10d618639c44 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:14.955280 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8f0bfd42-d625-4d26-96a4-10d618639c44 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:14.956075 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8f0bfd42-d625-4d26-96a4-10d618639c44 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:14.956580 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8f0bfd42-d625-4d26-96a4-10d618639c44 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:15.035815 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-8f0bfd42-d625-4d26-96a4-10d618639c44 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd628baac6cf64ce384d85eb0375b4c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1db64ecaea44e09ecbf80f34523511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:27:15.043805 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-8f0bfd42-d625-4d26-96a4-10d618639c44 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf" status: 200 len: 1187 microversion: 2.1 time: 0.100502 Jan 24 09:27:15.044392 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 598/1198] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:27:14 2022] GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf => generated 1187 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:27:16.060807 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-70a2f399-d19f-44d3-bf2b-0bb4e04922e9 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:27:16.061497 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-70a2f399-d19f-44d3-bf2b-0bb4e04922e9 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:27:16.069163 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-70a2f399-d19f-44d3-bf2b-0bb4e04922e9 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:16.069623 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-70a2f399-d19f-44d3-bf2b-0bb4e04922e9 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:16.070429 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-70a2f399-d19f-44d3-bf2b-0bb4e04922e9 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:16.070857 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-70a2f399-d19f-44d3-bf2b-0bb4e04922e9 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:16.142900 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-70a2f399-d19f-44d3-bf2b-0bb4e04922e9 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd628baac6cf64ce384d85eb0375b4c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1db64ecaea44e09ecbf80f34523511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:27:16.152051 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-70a2f399-d19f-44d3-bf2b-0bb4e04922e9 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf" status: 200 len: 1205 microversion: 2.1 time: 0.095026 Jan 24 09:27:16.162921 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 601/1199] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:27:16 2022] GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf => generated 1205 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:27:17.174897 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-ceca445a-2bfc-4a8a-80e1-8a1035557c0e tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:27:17.175643 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-ceca445a-2bfc-4a8a-80e1-8a1035557c0e tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:27:17.182446 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ceca445a-2bfc-4a8a-80e1-8a1035557c0e tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:17.183076 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ceca445a-2bfc-4a8a-80e1-8a1035557c0e tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:17.184283 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ceca445a-2bfc-4a8a-80e1-8a1035557c0e tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:17.184932 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ceca445a-2bfc-4a8a-80e1-8a1035557c0e tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:17.356768 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-ceca445a-2bfc-4a8a-80e1-8a1035557c0e tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd628baac6cf64ce384d85eb0375b4c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1db64ecaea44e09ecbf80f34523511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:27:17.365696 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-ceca445a-2bfc-4a8a-80e1-8a1035557c0e tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf" status: 200 len: 1273 microversion: 2.1 time: 0.195150 Jan 24 09:27:17.366315 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 599/1200] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:27:17 2022] GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf => generated 1273 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:27:17.871879 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [req-4940d1c1-8e3b-4b00-a049-5fc340366557 req-fc16bbec-4719-4e81-8884-f7c19c3eb369 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07611092-00af-4943-a30a-a3698c2520bf", "tag": "db0bed25-3789-4a53-af4c-4e01c8044a1e"}]} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:27:17.874650 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:27:17.874650 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: warnings.warn(msg) Jan 24 09:27:17.886878 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-4940d1c1-8e3b-4b00-a049-5fc340366557 req-fc16bbec-4719-4e81-8884-f7c19c3eb369 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:17.887280 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-4940d1c1-8e3b-4b00-a049-5fc340366557 req-fc16bbec-4719-4e81-8884-f7c19c3eb369 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:17.901881 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.compute.server_external_events [req-4940d1c1-8e3b-4b00-a049-5fc340366557 req-fc16bbec-4719-4e81-8884-f7c19c3eb369 service nova] Creating event network-changed:db0bed25-3789-4a53-af4c-4e01c8044a1e for instance 07611092-00af-4943-a30a-a3698c2520bf on hv-cinder-80403 Jan 24 09:27:17.907278 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [req-4940d1c1-8e3b-4b00-a049-5fc340366557 req-fc16bbec-4719-4e81-8884-f7c19c3eb369 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040149 Jan 24 09:27:17.908149 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 602/1201] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:27:18.383947 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-7d834176-801b-43a3-b31e-34a854155687 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:27:18.385149 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-7d834176-801b-43a3-b31e-34a854155687 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:27:18.402158 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7d834176-801b-43a3-b31e-34a854155687 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:18.402893 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7d834176-801b-43a3-b31e-34a854155687 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:18.403927 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7d834176-801b-43a3-b31e-34a854155687 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:18.404564 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7d834176-801b-43a3-b31e-34a854155687 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:18.763281 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-7d834176-801b-43a3-b31e-34a854155687 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd628baac6cf64ce384d85eb0375b4c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1db64ecaea44e09ecbf80f34523511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:27:18.776082 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-7d834176-801b-43a3-b31e-34a854155687 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf" status: 200 len: 1261 microversion: 2.1 time: 0.396365 Jan 24 09:27:18.789669 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 600/1202] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:27:18 2022] GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf => generated 1261 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:27:19.797465 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-3781fb85-0a1c-4915-9ba8-dd8fb062c236 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:27:19.798867 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-3781fb85-0a1c-4915-9ba8-dd8fb062c236 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:27:19.809133 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3781fb85-0a1c-4915-9ba8-dd8fb062c236 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:19.814168 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3781fb85-0a1c-4915-9ba8-dd8fb062c236 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:19.814168 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3781fb85-0a1c-4915-9ba8-dd8fb062c236 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:19.814168 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-3781fb85-0a1c-4915-9ba8-dd8fb062c236 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:19.973358 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-3781fb85-0a1c-4915-9ba8-dd8fb062c236 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd628baac6cf64ce384d85eb0375b4c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1db64ecaea44e09ecbf80f34523511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:27:19.981936 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-3781fb85-0a1c-4915-9ba8-dd8fb062c236 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf" status: 200 len: 1261 microversion: 2.1 time: 0.188998 Jan 24 09:27:19.991858 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 603/1203] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:27:19 2022] GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf => generated 1261 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:27:21.035834 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-eaf038d1-1d8b-4e78-af34-ac5a565f2bfe tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:27:21.035834 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-eaf038d1-1d8b-4e78-af34-ac5a565f2bfe tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:27:21.035834 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-eaf038d1-1d8b-4e78-af34-ac5a565f2bfe tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:21.035834 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-eaf038d1-1d8b-4e78-af34-ac5a565f2bfe tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:21.037465 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-eaf038d1-1d8b-4e78-af34-ac5a565f2bfe tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:21.037465 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-eaf038d1-1d8b-4e78-af34-ac5a565f2bfe tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:21.186283 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-eaf038d1-1d8b-4e78-af34-ac5a565f2bfe tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd628baac6cf64ce384d85eb0375b4c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1db64ecaea44e09ecbf80f34523511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:27:21.195156 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-eaf038d1-1d8b-4e78-af34-ac5a565f2bfe tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf" status: 200 len: 1261 microversion: 2.1 time: 0.200108 Jan 24 09:27:21.196096 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 601/1204] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:27:20 2022] GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf => generated 1261 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:27:22.211367 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-1a320f5e-b003-4569-8f97-168dbf12b190 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:27:22.212078 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-1a320f5e-b003-4569-8f97-168dbf12b190 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:27:22.219940 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1a320f5e-b003-4569-8f97-168dbf12b190 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:22.220742 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1a320f5e-b003-4569-8f97-168dbf12b190 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:22.221743 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1a320f5e-b003-4569-8f97-168dbf12b190 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:22.226805 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1a320f5e-b003-4569-8f97-168dbf12b190 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:22.395495 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-1a320f5e-b003-4569-8f97-168dbf12b190 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd628baac6cf64ce384d85eb0375b4c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1db64ecaea44e09ecbf80f34523511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:27:22.416649 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-1a320f5e-b003-4569-8f97-168dbf12b190 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf" status: 200 len: 1261 microversion: 2.1 time: 0.197872 Jan 24 09:27:22.416649 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 604/1205] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:27:22 2022] GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf => generated 1261 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:27:23.422534 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-96c06a31-5296-4d73-af6b-51759099378a tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:27:23.423858 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-96c06a31-5296-4d73-af6b-51759099378a tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:27:23.430990 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-96c06a31-5296-4d73-af6b-51759099378a tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:23.431525 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-96c06a31-5296-4d73-af6b-51759099378a tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:23.432621 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-96c06a31-5296-4d73-af6b-51759099378a tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:23.433502 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-96c06a31-5296-4d73-af6b-51759099378a tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:23.621269 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-96c06a31-5296-4d73-af6b-51759099378a tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd628baac6cf64ce384d85eb0375b4c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1db64ecaea44e09ecbf80f34523511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:27:23.629824 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-96c06a31-5296-4d73-af6b-51759099378a tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf" status: 200 len: 1261 microversion: 2.1 time: 0.210895 Jan 24 09:27:23.632308 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 602/1206] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:27:23 2022] GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf => generated 1261 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:27:24.648600 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-0adba44a-0b28-404d-bfda-675191e9b7b0 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:27:24.648600 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-0adba44a-0b28-404d-bfda-675191e9b7b0 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:27:24.656309 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0adba44a-0b28-404d-bfda-675191e9b7b0 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:24.657059 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0adba44a-0b28-404d-bfda-675191e9b7b0 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:24.658341 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0adba44a-0b28-404d-bfda-675191e9b7b0 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:24.658784 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0adba44a-0b28-404d-bfda-675191e9b7b0 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:24.822131 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-0adba44a-0b28-404d-bfda-675191e9b7b0 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd628baac6cf64ce384d85eb0375b4c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1db64ecaea44e09ecbf80f34523511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:27:24.830811 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-0adba44a-0b28-404d-bfda-675191e9b7b0 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf" status: 200 len: 1261 microversion: 2.1 time: 0.188296 Jan 24 09:27:24.836765 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 605/1207] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:27:24 2022] GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf => generated 1261 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:27:25.848185 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-225d86bc-a9f6-4a5f-bbb7-ba51ab6c57ad tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:27:25.849574 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-225d86bc-a9f6-4a5f-bbb7-ba51ab6c57ad tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:27:25.857588 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-225d86bc-a9f6-4a5f-bbb7-ba51ab6c57ad tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:25.858148 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-225d86bc-a9f6-4a5f-bbb7-ba51ab6c57ad tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:25.859032 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-225d86bc-a9f6-4a5f-bbb7-ba51ab6c57ad tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:25.859544 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-225d86bc-a9f6-4a5f-bbb7-ba51ab6c57ad tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:26.019714 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-225d86bc-a9f6-4a5f-bbb7-ba51ab6c57ad tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd628baac6cf64ce384d85eb0375b4c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1db64ecaea44e09ecbf80f34523511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:27:26.030352 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-225d86bc-a9f6-4a5f-bbb7-ba51ab6c57ad tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf" status: 200 len: 1261 microversion: 2.1 time: 0.186379 Jan 24 09:27:26.031056 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 603/1208] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:27:25 2022] GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf => generated 1261 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:27:27.054759 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-c6b886ff-02f1-41ce-afb4-cf92ac682ea2 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:27:27.055589 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-c6b886ff-02f1-41ce-afb4-cf92ac682ea2 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:27:27.062836 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c6b886ff-02f1-41ce-afb4-cf92ac682ea2 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:27.063852 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c6b886ff-02f1-41ce-afb4-cf92ac682ea2 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:27.066557 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c6b886ff-02f1-41ce-afb4-cf92ac682ea2 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:27.067535 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c6b886ff-02f1-41ce-afb4-cf92ac682ea2 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:27.221144 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-c6b886ff-02f1-41ce-afb4-cf92ac682ea2 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd628baac6cf64ce384d85eb0375b4c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1db64ecaea44e09ecbf80f34523511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:27:27.230797 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-c6b886ff-02f1-41ce-afb4-cf92ac682ea2 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf" status: 200 len: 1261 microversion: 2.1 time: 0.182439 Jan 24 09:27:27.231647 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 606/1209] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:27:27 2022] GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf => generated 1261 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:27:28.247870 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-857f43ca-cee0-4389-98bc-64f0dce7aece tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:27:28.248480 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-857f43ca-cee0-4389-98bc-64f0dce7aece tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:27:28.255871 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-857f43ca-cee0-4389-98bc-64f0dce7aece tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:28.256418 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-857f43ca-cee0-4389-98bc-64f0dce7aece tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:28.257251 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-857f43ca-cee0-4389-98bc-64f0dce7aece tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:28.257705 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-857f43ca-cee0-4389-98bc-64f0dce7aece tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:28.405240 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-857f43ca-cee0-4389-98bc-64f0dce7aece tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd628baac6cf64ce384d85eb0375b4c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1db64ecaea44e09ecbf80f34523511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:27:28.413549 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-857f43ca-cee0-4389-98bc-64f0dce7aece tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf" status: 200 len: 1261 microversion: 2.1 time: 0.169319 Jan 24 09:27:28.414189 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 604/1210] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:27:28 2022] GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf => generated 1261 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:27:28.778533 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-119a689b-0ffa-4b41-bafd-a29f054aada3 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Action: 'create', calling method: .version_select at 0x7f473d5c20d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1568865365"}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:27:28.794119 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.quota [None req-119a689b-0ffa-4b41-bafd-a29f054aada3 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Getting quotas for project a85801034a13431ebec2bd7a46843d7f. Resources: {'key_pairs'} {{(pid=116864) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 09:27:28.797161 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [req-5c7f0ffa-a233-4efc-9609-de90020a7e5d req-9acb1d8a-eaa3-47cd-b762-d2c220fc003c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07611092-00af-4943-a30a-a3698c2520bf", "name": "network-vif-plugged", "status": "completed", "tag": "db0bed25-3789-4a53-af4c-4e01c8044a1e"}]} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:27:28.797981 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.quota [None req-119a689b-0ffa-4b41-bafd-a29f054aada3 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Getting quotas for user 7acbca956188435bbf7de9480600bfd0 and project a85801034a13431ebec2bd7a46843d7f. Resources: {'key_pairs'} {{(pid=116864) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 09:27:28.798710 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:27:28.798710 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: warnings.warn(msg) Jan 24 09:27:28.805919 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-5c7f0ffa-a233-4efc-9609-de90020a7e5d req-9acb1d8a-eaa3-47cd-b762-d2c220fc003c service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:28.806459 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-5c7f0ffa-a233-4efc-9609-de90020a7e5d req-9acb1d8a-eaa3-47cd-b762-d2c220fc003c service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:28.820647 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.compute.server_external_events [req-5c7f0ffa-a233-4efc-9609-de90020a7e5d req-9acb1d8a-eaa3-47cd-b762-d2c220fc003c service nova] Creating event network-vif-plugged:db0bed25-3789-4a53-af4c-4e01c8044a1e for instance 07611092-00af-4943-a30a-a3698c2520bf on hv-cinder-80403 Jan 24 09:27:28.825912 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [req-5c7f0ffa-a233-4efc-9609-de90020a7e5d req-9acb1d8a-eaa3-47cd-b762-d2c220fc003c service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032335 Jan 24 09:27:28.826970 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 605/1211] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 09:27:29.269205 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.quota [None req-119a689b-0ffa-4b41-bafd-a29f054aada3 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Getting quotas for project a85801034a13431ebec2bd7a46843d7f. Resources: {'key_pairs'} {{(pid=116864) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 09:27:29.272839 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.quota [None req-119a689b-0ffa-4b41-bafd-a29f054aada3 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Getting quotas for user 7acbca956188435bbf7de9480600bfd0 and project a85801034a13431ebec2bd7a46843d7f. Resources: {'key_pairs'} {{(pid=116864) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 09:27:29.287200 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-119a689b-0ffa-4b41-bafd-a29f054aada3 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.512453 Jan 24 09:27:29.288004 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 607/1212] 10.222.0.113 () {60 vars in 1162 bytes} [Mon Jan 24 09:27:28 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:27:29.339793 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-36bc67c7-197d-4f0b-82d5-560ac011dd71 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1013541280", "imageRef": "a02033ed-bea2-4056-ac32-be3f302d19c2", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1568865365", "networks": [{"uuid": "35e4a580-1225-42f2-ae53-8dac63074cc7"}]}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:27:29.392530 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.network.neutron [None req-36bc67c7-197d-4f0b-82d5-560ac011dd71 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] validate_networks() for [('35e4a580-1225-42f2-ae53-8dac63074cc7', None, None, None, None, None)] {{(pid=116863) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 09:27:29.431098 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-296bcba5-5c98-49e6-a9dc-1373374330b5 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:27:29.431802 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-296bcba5-5c98-49e6-a9dc-1373374330b5 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:27:29.438078 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-296bcba5-5c98-49e6-a9dc-1373374330b5 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:29.438563 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-296bcba5-5c98-49e6-a9dc-1373374330b5 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:29.439695 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-296bcba5-5c98-49e6-a9dc-1373374330b5 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:29.439813 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-296bcba5-5c98-49e6-a9dc-1373374330b5 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:29.584277 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-296bcba5-5c98-49e6-a9dc-1373374330b5 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd628baac6cf64ce384d85eb0375b4c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1db64ecaea44e09ecbf80f34523511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:27:29.591861 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-296bcba5-5c98-49e6-a9dc-1373374330b5 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf" status: 200 len: 1261 microversion: 2.1 time: 0.164529 Jan 24 09:27:29.592449 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 608/1213] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:27:29 2022] GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf => generated 1261 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:27:29.830539 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.virt.hardware [None req-36bc67c7-197d-4f0b-82d5-560ac011dd71 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Flavor limits 0:0:0 {{(pid=116863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 09:27:29.830976 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.virt.hardware [None req-36bc67c7-197d-4f0b-82d5-560ac011dd71 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Image limits 0:0:0 {{(pid=116863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 09:27:29.831470 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.virt.hardware [None req-36bc67c7-197d-4f0b-82d5-560ac011dd71 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Flavor pref 0:0:0 {{(pid=116863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 09:27:29.831882 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.virt.hardware [None req-36bc67c7-197d-4f0b-82d5-560ac011dd71 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Image pref 0:0:0 {{(pid=116863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 09:27:29.832299 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.virt.hardware [None req-36bc67c7-197d-4f0b-82d5-560ac011dd71 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 09:27:29.841165 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-36bc67c7-197d-4f0b-82d5-560ac011dd71 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:29.841614 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-36bc67c7-197d-4f0b-82d5-560ac011dd71 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:29.842463 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-36bc67c7-197d-4f0b-82d5-560ac011dd71 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:29.842896 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-36bc67c7-197d-4f0b-82d5-560ac011dd71 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:29.859344 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.quota [None req-36bc67c7-197d-4f0b-82d5-560ac011dd71 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Getting quotas for project a85801034a13431ebec2bd7a46843d7f. Resources: {'ram', 'cores', 'instances'} {{(pid=116863) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 09:27:29.864079 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.quota [None req-36bc67c7-197d-4f0b-82d5-560ac011dd71 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Getting quotas for user 7acbca956188435bbf7de9480600bfd0 and project a85801034a13431ebec2bd7a46843d7f. Resources: {'ram', 'cores', 'instances'} {{(pid=116863) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 09:27:29.874916 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-36bc67c7-197d-4f0b-82d5-560ac011dd71 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Going to run 1 instances... {{(pid=116863) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 09:27:29.877274 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-36bc67c7-197d-4f0b-82d5-560ac011dd71 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] [instance: caa08f39-54c9-4b4c-8c4d-03ebefd457f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a02033ed-bea2-4056-ac32-be3f302d19c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 09:27:30.042577 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-36bc67c7-197d-4f0b-82d5-560ac011dd71 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.708033 Jan 24 09:27:30.043147 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 606/1214] 10.222.0.113 () {60 vars in 1151 bytes} [Mon Jan 24 09:27:29 2022] POST /compute/v2.1/servers => generated 382 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 24 09:27:30.053752 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-1291d566-f0b8-4219-b7aa-5915c30086a9 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:27:30.054404 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-1291d566-f0b8-4219-b7aa-5915c30086a9 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] [instance: caa08f39-54c9-4b4c-8c4d-03ebefd457f6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:27:30.106133 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-1291d566-f0b8-4219-b7aa-5915c30086a9 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acbca956188435bbf7de9480600bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85801034a13431ebec2bd7a46843d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:27:30.113060 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-1291d566-f0b8-4219-b7aa-5915c30086a9 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] 10.222.0.113 "GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6" status: 200 len: 1263 microversion: 2.1 time: 0.063359 Jan 24 09:27:30.113656 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 609/1215] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:27:30 2022] GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6 => generated 1263 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:27:30.609483 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-01223b18-4645-4d35-986a-9d79f75eaf21 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:27:30.610127 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-01223b18-4645-4d35-986a-9d79f75eaf21 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:27:30.622480 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-01223b18-4645-4d35-986a-9d79f75eaf21 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:30.622480 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-01223b18-4645-4d35-986a-9d79f75eaf21 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:30.622480 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-01223b18-4645-4d35-986a-9d79f75eaf21 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:30.622480 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-01223b18-4645-4d35-986a-9d79f75eaf21 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:30.783572 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-01223b18-4645-4d35-986a-9d79f75eaf21 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd628baac6cf64ce384d85eb0375b4c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1db64ecaea44e09ecbf80f34523511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:27:30.783572 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-01223b18-4645-4d35-986a-9d79f75eaf21 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf" status: 200 len: 1261 microversion: 2.1 time: 0.168345 Jan 24 09:27:30.783572 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 607/1216] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:27:30 2022] GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf => generated 1261 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:27:31.130485 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-67edce88-8a3b-4150-8bbf-3f8300df1823 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:27:31.131209 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-67edce88-8a3b-4150-8bbf-3f8300df1823 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] [instance: caa08f39-54c9-4b4c-8c4d-03ebefd457f6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:27:31.187752 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-67edce88-8a3b-4150-8bbf-3f8300df1823 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acbca956188435bbf7de9480600bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85801034a13431ebec2bd7a46843d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:27:31.195300 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-67edce88-8a3b-4150-8bbf-3f8300df1823 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] 10.222.0.113 "GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6" status: 200 len: 1263 microversion: 2.1 time: 0.069304 Jan 24 09:27:31.195870 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 610/1217] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:27:31 2022] GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6 => generated 1263 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:27:31.792092 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-1551fac7-f915-402b-96d2-defea899ee48 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:27:31.792730 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-1551fac7-f915-402b-96d2-defea899ee48 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:27:31.799491 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1551fac7-f915-402b-96d2-defea899ee48 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:31.801407 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1551fac7-f915-402b-96d2-defea899ee48 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:31.801528 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1551fac7-f915-402b-96d2-defea899ee48 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:31.801975 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-1551fac7-f915-402b-96d2-defea899ee48 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:31.938446 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-1551fac7-f915-402b-96d2-defea899ee48 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd628baac6cf64ce384d85eb0375b4c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1db64ecaea44e09ecbf80f34523511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:27:31.945975 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-1551fac7-f915-402b-96d2-defea899ee48 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf" status: 200 len: 1444 microversion: 2.1 time: 0.158400 Jan 24 09:27:31.946570 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 608/1218] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:27:31 2022] GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf => generated 1444 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:27:31.962281 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-64e256b7-45ec-4301-8e73-e27be3021a17 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:27:31.962903 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-64e256b7-45ec-4301-8e73-e27be3021a17 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:27:31.970894 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-64e256b7-45ec-4301-8e73-e27be3021a17 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:31.971464 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-64e256b7-45ec-4301-8e73-e27be3021a17 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:31.972934 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-64e256b7-45ec-4301-8e73-e27be3021a17 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:31.973339 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-64e256b7-45ec-4301-8e73-e27be3021a17 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:32.113663 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-64e256b7-45ec-4301-8e73-e27be3021a17 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd628baac6cf64ce384d85eb0375b4c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1db64ecaea44e09ecbf80f34523511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:27:32.121946 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-64e256b7-45ec-4301-8e73-e27be3021a17 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf" status: 200 len: 1444 microversion: 2.1 time: 0.163456 Jan 24 09:27:32.122558 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 611/1219] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:27:31 2022] GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf => generated 1444 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:27:32.213478 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-b4e58ed8-494e-4ce0-a196-5cdbdfcd853f tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:27:32.213977 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-b4e58ed8-494e-4ce0-a196-5cdbdfcd853f tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] [instance: caa08f39-54c9-4b4c-8c4d-03ebefd457f6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:27:32.219957 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b4e58ed8-494e-4ce0-a196-5cdbdfcd853f tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:32.220580 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b4e58ed8-494e-4ce0-a196-5cdbdfcd853f tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:32.221366 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b4e58ed8-494e-4ce0-a196-5cdbdfcd853f tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:32.221983 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b4e58ed8-494e-4ce0-a196-5cdbdfcd853f tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:32.304777 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-b4e58ed8-494e-4ce0-a196-5cdbdfcd853f tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acbca956188435bbf7de9480600bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85801034a13431ebec2bd7a46843d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:27:32.312989 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-b4e58ed8-494e-4ce0-a196-5cdbdfcd853f tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] 10.222.0.113 "GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6" status: 200 len: 1315 microversion: 2.1 time: 0.102518 Jan 24 09:27:32.313583 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 609/1220] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:27:32 2022] GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6 => generated 1315 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:27:33.331746 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-16874b3b-c3a4-449e-b656-40e721332a88 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:27:33.334836 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-16874b3b-c3a4-449e-b656-40e721332a88 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] [instance: caa08f39-54c9-4b4c-8c4d-03ebefd457f6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:27:33.346279 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-16874b3b-c3a4-449e-b656-40e721332a88 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:33.348232 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-16874b3b-c3a4-449e-b656-40e721332a88 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:33.349758 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-16874b3b-c3a4-449e-b656-40e721332a88 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:33.350642 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-16874b3b-c3a4-449e-b656-40e721332a88 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:33.479060 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-16874b3b-c3a4-449e-b656-40e721332a88 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acbca956188435bbf7de9480600bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85801034a13431ebec2bd7a46843d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:27:33.492375 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-16874b3b-c3a4-449e-b656-40e721332a88 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] 10.222.0.113 "GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6" status: 200 len: 1321 microversion: 2.1 time: 0.165323 Jan 24 09:27:33.493018 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 612/1221] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:27:33 2022] GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:27:34.511166 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-aae1f43d-3d33-4822-be95-af2c7060aa9d tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:27:34.512805 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-aae1f43d-3d33-4822-be95-af2c7060aa9d tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] [instance: caa08f39-54c9-4b4c-8c4d-03ebefd457f6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:27:34.523013 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-aae1f43d-3d33-4822-be95-af2c7060aa9d tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:34.523887 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-aae1f43d-3d33-4822-be95-af2c7060aa9d tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:34.525197 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-aae1f43d-3d33-4822-be95-af2c7060aa9d tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:34.525930 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-aae1f43d-3d33-4822-be95-af2c7060aa9d tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:34.736167 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-aae1f43d-3d33-4822-be95-af2c7060aa9d tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acbca956188435bbf7de9480600bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85801034a13431ebec2bd7a46843d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:27:34.753887 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-aae1f43d-3d33-4822-be95-af2c7060aa9d tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] 10.222.0.113 "GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6" status: 200 len: 1363 microversion: 2.1 time: 0.247265 Jan 24 09:27:34.755707 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 610/1222] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:27:34 2022] GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6 => generated 1363 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:27:35.234253 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [req-bd47faf4-bba9-4de7-833c-e10b0a9b6718 req-78563b91-d2b2-4cd7-912a-3f101d6128d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07611092-00af-4943-a30a-a3698c2520bf", "tag": "db0bed25-3789-4a53-af4c-4e01c8044a1e"}]} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:27:35.236481 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:27:35.236481 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: warnings.warn(msg) Jan 24 09:27:35.245964 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-bd47faf4-bba9-4de7-833c-e10b0a9b6718 req-78563b91-d2b2-4cd7-912a-3f101d6128d2 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:35.246750 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-bd47faf4-bba9-4de7-833c-e10b0a9b6718 req-78563b91-d2b2-4cd7-912a-3f101d6128d2 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:35.282828 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.compute.server_external_events [req-bd47faf4-bba9-4de7-833c-e10b0a9b6718 req-78563b91-d2b2-4cd7-912a-3f101d6128d2 service nova] Creating event network-changed:db0bed25-3789-4a53-af4c-4e01c8044a1e for instance 07611092-00af-4943-a30a-a3698c2520bf on hv-cinder-80403 Jan 24 09:27:35.292315 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [req-bd47faf4-bba9-4de7-833c-e10b0a9b6718 req-78563b91-d2b2-4cd7-912a-3f101d6128d2 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061807 Jan 24 09:27:35.293283 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 613/1223] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 09:27:35.786698 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-37c60761-5c76-4a42-841a-f6804dd50ad8 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:27:35.788873 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-37c60761-5c76-4a42-841a-f6804dd50ad8 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] [instance: caa08f39-54c9-4b4c-8c4d-03ebefd457f6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:27:35.800816 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-37c60761-5c76-4a42-841a-f6804dd50ad8 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:35.802013 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-37c60761-5c76-4a42-841a-f6804dd50ad8 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:35.803781 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-37c60761-5c76-4a42-841a-f6804dd50ad8 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:35.804848 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-37c60761-5c76-4a42-841a-f6804dd50ad8 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:36.022624 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-37c60761-5c76-4a42-841a-f6804dd50ad8 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acbca956188435bbf7de9480600bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85801034a13431ebec2bd7a46843d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:27:36.029880 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-37c60761-5c76-4a42-841a-f6804dd50ad8 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] 10.222.0.113 "GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6" status: 200 len: 1363 microversion: 2.1 time: 0.253967 Jan 24 09:27:36.030739 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 611/1224] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:27:35 2022] GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6 => generated 1363 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:27:37.048696 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-5686237c-fba4-4176-b54b-eaa355096ea5 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:27:37.049558 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-5686237c-fba4-4176-b54b-eaa355096ea5 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] [instance: caa08f39-54c9-4b4c-8c4d-03ebefd457f6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:27:37.057677 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5686237c-fba4-4176-b54b-eaa355096ea5 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:37.058066 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5686237c-fba4-4176-b54b-eaa355096ea5 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:37.059139 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5686237c-fba4-4176-b54b-eaa355096ea5 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:37.059733 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-5686237c-fba4-4176-b54b-eaa355096ea5 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:37.204182 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-5686237c-fba4-4176-b54b-eaa355096ea5 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acbca956188435bbf7de9480600bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85801034a13431ebec2bd7a46843d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:27:37.211836 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-5686237c-fba4-4176-b54b-eaa355096ea5 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] 10.222.0.113 "GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6" status: 200 len: 1363 microversion: 2.1 time: 0.167584 Jan 24 09:27:37.212403 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 614/1225] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:27:37 2022] GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:27:38.235755 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-8615f1de-f2c9-4833-b944-f0f7a651fc28 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:27:38.236367 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-8615f1de-f2c9-4833-b944-f0f7a651fc28 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] [instance: caa08f39-54c9-4b4c-8c4d-03ebefd457f6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:27:38.243709 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8615f1de-f2c9-4833-b944-f0f7a651fc28 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:38.250783 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8615f1de-f2c9-4833-b944-f0f7a651fc28 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:38.250783 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8615f1de-f2c9-4833-b944-f0f7a651fc28 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:38.250783 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-8615f1de-f2c9-4833-b944-f0f7a651fc28 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:38.381008 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-8615f1de-f2c9-4833-b944-f0f7a651fc28 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acbca956188435bbf7de9480600bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85801034a13431ebec2bd7a46843d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:27:38.388355 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-8615f1de-f2c9-4833-b944-f0f7a651fc28 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] 10.222.0.113 "GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6" status: 200 len: 1363 microversion: 2.1 time: 0.160787 Jan 24 09:27:38.388917 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 612/1226] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:27:38 2022] GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:27:39.409817 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-efe7df79-cf5c-4f8a-8265-2a6bdd6da517 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:27:39.410799 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-efe7df79-cf5c-4f8a-8265-2a6bdd6da517 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] [instance: caa08f39-54c9-4b4c-8c4d-03ebefd457f6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:27:39.419128 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-efe7df79-cf5c-4f8a-8265-2a6bdd6da517 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:39.419842 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-efe7df79-cf5c-4f8a-8265-2a6bdd6da517 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:39.420765 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-efe7df79-cf5c-4f8a-8265-2a6bdd6da517 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:39.421304 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-efe7df79-cf5c-4f8a-8265-2a6bdd6da517 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:39.576773 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-efe7df79-cf5c-4f8a-8265-2a6bdd6da517 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acbca956188435bbf7de9480600bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85801034a13431ebec2bd7a46843d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:27:39.586445 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-efe7df79-cf5c-4f8a-8265-2a6bdd6da517 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] 10.222.0.113 "GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6" status: 200 len: 1363 microversion: 2.1 time: 0.181270 Jan 24 09:27:39.591524 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 615/1227] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:27:39 2022] GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6 => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:27:40.603835 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-0042d33c-b6ff-460f-a021-cbd393902478 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:27:40.605387 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-0042d33c-b6ff-460f-a021-cbd393902478 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] [instance: caa08f39-54c9-4b4c-8c4d-03ebefd457f6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:27:40.613014 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0042d33c-b6ff-460f-a021-cbd393902478 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:40.613677 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0042d33c-b6ff-460f-a021-cbd393902478 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:40.614579 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0042d33c-b6ff-460f-a021-cbd393902478 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:40.615111 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-0042d33c-b6ff-460f-a021-cbd393902478 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:40.764079 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-0042d33c-b6ff-460f-a021-cbd393902478 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acbca956188435bbf7de9480600bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85801034a13431ebec2bd7a46843d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:27:40.772767 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-0042d33c-b6ff-460f-a021-cbd393902478 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] 10.222.0.113 "GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6" status: 200 len: 1363 microversion: 2.1 time: 0.172596 Jan 24 09:27:40.773455 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 613/1228] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:27:40 2022] GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:27:41.790028 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-2580620a-2554-4bb9-bb49-1c294beaca0e tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:27:41.790664 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-2580620a-2554-4bb9-bb49-1c294beaca0e tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] [instance: caa08f39-54c9-4b4c-8c4d-03ebefd457f6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:27:41.796880 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2580620a-2554-4bb9-bb49-1c294beaca0e tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:41.797334 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2580620a-2554-4bb9-bb49-1c294beaca0e tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:41.798219 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2580620a-2554-4bb9-bb49-1c294beaca0e tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:41.798666 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-2580620a-2554-4bb9-bb49-1c294beaca0e tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:41.951515 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-2580620a-2554-4bb9-bb49-1c294beaca0e tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acbca956188435bbf7de9480600bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85801034a13431ebec2bd7a46843d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:27:41.959766 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-2580620a-2554-4bb9-bb49-1c294beaca0e tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] 10.222.0.113 "GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6" status: 200 len: 1363 microversion: 2.1 time: 0.173438 Jan 24 09:27:41.960358 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 616/1229] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:27:41 2022] GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:27:42.977533 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-07708ff0-629f-4adf-b26a-8f4ab5d46aa3 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:27:42.978825 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-07708ff0-629f-4adf-b26a-8f4ab5d46aa3 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] [instance: caa08f39-54c9-4b4c-8c4d-03ebefd457f6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:27:42.985592 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-07708ff0-629f-4adf-b26a-8f4ab5d46aa3 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:42.986036 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-07708ff0-629f-4adf-b26a-8f4ab5d46aa3 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:42.986884 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-07708ff0-629f-4adf-b26a-8f4ab5d46aa3 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:42.987439 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-07708ff0-629f-4adf-b26a-8f4ab5d46aa3 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:43.143729 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-07708ff0-629f-4adf-b26a-8f4ab5d46aa3 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acbca956188435bbf7de9480600bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85801034a13431ebec2bd7a46843d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:27:43.152378 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-07708ff0-629f-4adf-b26a-8f4ab5d46aa3 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] 10.222.0.113 "GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6" status: 200 len: 1363 microversion: 2.1 time: 0.179496 Jan 24 09:27:43.152966 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 614/1230] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:27:42 2022] GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:27:44.170743 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-dcf32d6c-92a6-466b-a039-e103e6d98891 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:27:44.171353 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-dcf32d6c-92a6-466b-a039-e103e6d98891 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] [instance: caa08f39-54c9-4b4c-8c4d-03ebefd457f6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:27:44.178700 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-dcf32d6c-92a6-466b-a039-e103e6d98891 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:44.179145 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-dcf32d6c-92a6-466b-a039-e103e6d98891 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:44.179937 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-dcf32d6c-92a6-466b-a039-e103e6d98891 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:44.180374 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-dcf32d6c-92a6-466b-a039-e103e6d98891 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:44.410620 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-dcf32d6c-92a6-466b-a039-e103e6d98891 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acbca956188435bbf7de9480600bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85801034a13431ebec2bd7a46843d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:27:44.418043 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-dcf32d6c-92a6-466b-a039-e103e6d98891 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] 10.222.0.113 "GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6" status: 200 len: 1363 microversion: 2.1 time: 0.250960 Jan 24 09:27:44.418818 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 617/1231] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:27:44 2022] GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6 => generated 1363 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:27:44.988226 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [req-4638b0ea-4289-41d7-8773-99d54c46ee6f req-0d4138c6-df7c-4065-a275-a8980384d156 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caa08f39-54c9-4b4c-8c4d-03ebefd457f6", "tag": "07a87910-5cf2-42f0-b095-d0bea4cd1a88"}]} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:27:44.990179 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:27:44.990179 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: warnings.warn(msg) Jan 24 09:27:44.998780 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-4638b0ea-4289-41d7-8773-99d54c46ee6f req-0d4138c6-df7c-4065-a275-a8980384d156 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:45.000323 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-4638b0ea-4289-41d7-8773-99d54c46ee6f req-0d4138c6-df7c-4065-a275-a8980384d156 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:45.013279 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.compute.server_external_events [req-4638b0ea-4289-41d7-8773-99d54c46ee6f req-0d4138c6-df7c-4065-a275-a8980384d156 service nova] Creating event network-changed:07a87910-5cf2-42f0-b095-d0bea4cd1a88 for instance caa08f39-54c9-4b4c-8c4d-03ebefd457f6 on hv-cinder-80403 Jan 24 09:27:45.018578 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [req-4638b0ea-4289-41d7-8773-99d54c46ee6f req-0d4138c6-df7c-4065-a275-a8980384d156 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099552 Jan 24 09:27:45.019222 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 615/1232] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:27:45.435195 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-bc78949e-23b6-4079-8fc2-ff941b064549 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:27:45.436053 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-bc78949e-23b6-4079-8fc2-ff941b064549 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] [instance: caa08f39-54c9-4b4c-8c4d-03ebefd457f6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:27:45.445138 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-bc78949e-23b6-4079-8fc2-ff941b064549 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:45.445601 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-bc78949e-23b6-4079-8fc2-ff941b064549 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:45.446452 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-bc78949e-23b6-4079-8fc2-ff941b064549 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:45.446896 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-bc78949e-23b6-4079-8fc2-ff941b064549 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:45.582491 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-bc78949e-23b6-4079-8fc2-ff941b064549 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acbca956188435bbf7de9480600bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85801034a13431ebec2bd7a46843d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:27:45.589974 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-bc78949e-23b6-4079-8fc2-ff941b064549 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] 10.222.0.113 "GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6" status: 200 len: 1363 microversion: 2.1 time: 0.158413 Jan 24 09:27:45.591037 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 618/1233] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:27:45 2022] GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:27:46.608480 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-fd3d11cc-9a5b-4585-ae05-bb8a0bfa99b7 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:27:46.657012 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-fd3d11cc-9a5b-4585-ae05-bb8a0bfa99b7 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] [instance: caa08f39-54c9-4b4c-8c4d-03ebefd457f6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:27:46.657012 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-fd3d11cc-9a5b-4585-ae05-bb8a0bfa99b7 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:46.657012 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-fd3d11cc-9a5b-4585-ae05-bb8a0bfa99b7 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:46.657012 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-fd3d11cc-9a5b-4585-ae05-bb8a0bfa99b7 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:46.657464 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-fd3d11cc-9a5b-4585-ae05-bb8a0bfa99b7 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:46.763156 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-fd3d11cc-9a5b-4585-ae05-bb8a0bfa99b7 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acbca956188435bbf7de9480600bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85801034a13431ebec2bd7a46843d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:27:46.770548 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-fd3d11cc-9a5b-4585-ae05-bb8a0bfa99b7 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] 10.222.0.113 "GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6" status: 200 len: 1363 microversion: 2.1 time: 0.166297 Jan 24 09:27:46.771146 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 616/1234] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:27:46 2022] GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:27:47.788330 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-69e38182-acea-4ad5-a878-163c0abf06c3 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:27:47.788889 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-69e38182-acea-4ad5-a878-163c0abf06c3 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] [instance: caa08f39-54c9-4b4c-8c4d-03ebefd457f6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:27:47.795239 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-69e38182-acea-4ad5-a878-163c0abf06c3 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:47.795689 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-69e38182-acea-4ad5-a878-163c0abf06c3 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:47.796475 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-69e38182-acea-4ad5-a878-163c0abf06c3 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:47.796942 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-69e38182-acea-4ad5-a878-163c0abf06c3 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:47.936356 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-69e38182-acea-4ad5-a878-163c0abf06c3 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acbca956188435bbf7de9480600bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85801034a13431ebec2bd7a46843d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:27:47.944790 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-69e38182-acea-4ad5-a878-163c0abf06c3 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] 10.222.0.113 "GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6" status: 200 len: 1363 microversion: 2.1 time: 0.159858 Jan 24 09:27:47.945387 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 619/1235] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:27:47 2022] GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:27:48.960973 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-3ddaf44d-e8fe-4523-a2e4-bdaa8d5917a9 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:27:48.961548 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-3ddaf44d-e8fe-4523-a2e4-bdaa8d5917a9 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] [instance: caa08f39-54c9-4b4c-8c4d-03ebefd457f6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:27:48.967977 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3ddaf44d-e8fe-4523-a2e4-bdaa8d5917a9 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:48.968424 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3ddaf44d-e8fe-4523-a2e4-bdaa8d5917a9 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:48.969248 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3ddaf44d-e8fe-4523-a2e4-bdaa8d5917a9 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:48.969689 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3ddaf44d-e8fe-4523-a2e4-bdaa8d5917a9 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:49.125146 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-3ddaf44d-e8fe-4523-a2e4-bdaa8d5917a9 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acbca956188435bbf7de9480600bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85801034a13431ebec2bd7a46843d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:27:49.133040 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-3ddaf44d-e8fe-4523-a2e4-bdaa8d5917a9 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] 10.222.0.113 "GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6" status: 200 len: 1363 microversion: 2.1 time: 0.175783 Jan 24 09:27:49.133631 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 617/1236] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:27:48 2022] GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:27:50.150594 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-a2c83564-14b8-4cd0-8de4-4a6832b17cdf tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:27:50.151162 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-a2c83564-14b8-4cd0-8de4-4a6832b17cdf tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] [instance: caa08f39-54c9-4b4c-8c4d-03ebefd457f6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:27:50.157793 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a2c83564-14b8-4cd0-8de4-4a6832b17cdf tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:50.158285 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a2c83564-14b8-4cd0-8de4-4a6832b17cdf tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:50.159067 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a2c83564-14b8-4cd0-8de4-4a6832b17cdf tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:50.159508 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a2c83564-14b8-4cd0-8de4-4a6832b17cdf tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:50.290309 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-a2c83564-14b8-4cd0-8de4-4a6832b17cdf tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acbca956188435bbf7de9480600bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85801034a13431ebec2bd7a46843d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:27:50.297561 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-a2c83564-14b8-4cd0-8de4-4a6832b17cdf tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] 10.222.0.113 "GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6" status: 200 len: 1363 microversion: 2.1 time: 0.151539 Jan 24 09:27:50.298165 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 620/1237] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:27:50 2022] GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:27:50.949138 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [req-51a77f13-4b9a-4d1b-a655-5bc4e03ff864 req-cb0991c6-0827-43c9-838c-0c87fbe59c38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caa08f39-54c9-4b4c-8c4d-03ebefd457f6", "name": "network-vif-plugged", "status": "completed", "tag": "07a87910-5cf2-42f0-b095-d0bea4cd1a88"}]} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:27:50.950788 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:27:50.950788 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: warnings.warn(msg) Jan 24 09:27:50.958404 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-51a77f13-4b9a-4d1b-a655-5bc4e03ff864 req-cb0991c6-0827-43c9-838c-0c87fbe59c38 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:50.958849 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-51a77f13-4b9a-4d1b-a655-5bc4e03ff864 req-cb0991c6-0827-43c9-838c-0c87fbe59c38 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:50.970626 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.compute.server_external_events [req-51a77f13-4b9a-4d1b-a655-5bc4e03ff864 req-cb0991c6-0827-43c9-838c-0c87fbe59c38 service nova] Creating event network-vif-plugged:07a87910-5cf2-42f0-b095-d0bea4cd1a88 for instance caa08f39-54c9-4b4c-8c4d-03ebefd457f6 on hv-cinder-80403 Jan 24 09:27:50.976397 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [req-51a77f13-4b9a-4d1b-a655-5bc4e03ff864 req-cb0991c6-0827-43c9-838c-0c87fbe59c38 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030477 Jan 24 09:27:50.981532 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 618/1238] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:27:51.314084 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-93126bdb-1517-493f-b1c5-dc77c8e3db2f tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:27:51.314791 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-93126bdb-1517-493f-b1c5-dc77c8e3db2f tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] [instance: caa08f39-54c9-4b4c-8c4d-03ebefd457f6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:27:51.321768 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-93126bdb-1517-493f-b1c5-dc77c8e3db2f tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:51.322259 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-93126bdb-1517-493f-b1c5-dc77c8e3db2f tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:51.323046 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-93126bdb-1517-493f-b1c5-dc77c8e3db2f tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:51.323500 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-93126bdb-1517-493f-b1c5-dc77c8e3db2f tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:51.456380 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-93126bdb-1517-493f-b1c5-dc77c8e3db2f tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acbca956188435bbf7de9480600bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85801034a13431ebec2bd7a46843d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:27:51.464110 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-93126bdb-1517-493f-b1c5-dc77c8e3db2f tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] 10.222.0.113 "GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6" status: 200 len: 1363 microversion: 2.1 time: 0.153763 Jan 24 09:27:51.464680 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 621/1239] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:27:51 2022] GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:27:52.481408 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-b59c0ec0-3e36-481f-9fea-a1f14930644f tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:27:52.482122 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-b59c0ec0-3e36-481f-9fea-a1f14930644f tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] [instance: caa08f39-54c9-4b4c-8c4d-03ebefd457f6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:27:52.488327 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b59c0ec0-3e36-481f-9fea-a1f14930644f tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:52.488764 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b59c0ec0-3e36-481f-9fea-a1f14930644f tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:52.489642 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b59c0ec0-3e36-481f-9fea-a1f14930644f tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:52.489956 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b59c0ec0-3e36-481f-9fea-a1f14930644f tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:52.626529 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-b59c0ec0-3e36-481f-9fea-a1f14930644f tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acbca956188435bbf7de9480600bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85801034a13431ebec2bd7a46843d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:27:52.634648 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-b59c0ec0-3e36-481f-9fea-a1f14930644f tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] 10.222.0.113 "GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6" status: 200 len: 1363 microversion: 2.1 time: 0.157591 Jan 24 09:27:52.635298 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 619/1240] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:27:52 2022] GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:27:53.652627 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-73060da4-e276-45a6-8729-60b672ed398d tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:27:53.653243 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-73060da4-e276-45a6-8729-60b672ed398d tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] [instance: caa08f39-54c9-4b4c-8c4d-03ebefd457f6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:27:53.659748 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-73060da4-e276-45a6-8729-60b672ed398d tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:53.660202 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-73060da4-e276-45a6-8729-60b672ed398d tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:53.660980 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-73060da4-e276-45a6-8729-60b672ed398d tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:53.661417 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-73060da4-e276-45a6-8729-60b672ed398d tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:53.789924 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-73060da4-e276-45a6-8729-60b672ed398d tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acbca956188435bbf7de9480600bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85801034a13431ebec2bd7a46843d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:27:53.797534 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-73060da4-e276-45a6-8729-60b672ed398d tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] 10.222.0.113 "GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6" status: 200 len: 1553 microversion: 2.1 time: 0.148543 Jan 24 09:27:53.798135 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 622/1241] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:27:53 2022] GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6 => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:27:53.813461 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-a59c5d4c-56cf-4c6f-8891-866e93690beb tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:27:53.814118 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-a59c5d4c-56cf-4c6f-8891-866e93690beb tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] [instance: caa08f39-54c9-4b4c-8c4d-03ebefd457f6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:27:53.820856 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a59c5d4c-56cf-4c6f-8891-866e93690beb tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:53.821297 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a59c5d4c-56cf-4c6f-8891-866e93690beb tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:53.822058 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a59c5d4c-56cf-4c6f-8891-866e93690beb tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:53.822513 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-a59c5d4c-56cf-4c6f-8891-866e93690beb tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:53.960556 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-a59c5d4c-56cf-4c6f-8891-866e93690beb tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acbca956188435bbf7de9480600bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85801034a13431ebec2bd7a46843d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:27:53.968456 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-a59c5d4c-56cf-4c6f-8891-866e93690beb tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] 10.222.0.113 "GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6" status: 200 len: 1553 microversion: 2.1 time: 0.158507 Jan 24 09:27:53.969044 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 620/1242] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:27:53 2022] GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6 => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:27:53.984422 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-459b5462-58b4-4ed6-8d00-41384bf72c9e tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:27:53.988002 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:27:53.988002 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: warnings.warn(msg) Jan 24 09:27:53.989005 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-459b5462-58b4-4ed6-8d00-41384bf72c9e tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7acbca956188435bbf7de9480600bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85801034a13431ebec2bd7a46843d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:27:53.989847 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-459b5462-58b4-4ed6-8d00-41384bf72c9e tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Searching by: {'deleted': False, 'project_id': 'a85801034a13431ebec2bd7a46843d7f'} {{(pid=116864) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 24 09:27:53.997438 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-459b5462-58b4-4ed6-8d00-41384bf72c9e tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:53.997936 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-459b5462-58b4-4ed6-8d00-41384bf72c9e tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:53.998765 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-459b5462-58b4-4ed6-8d00-41384bf72c9e tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:53.999206 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-459b5462-58b4-4ed6-8d00-41384bf72c9e tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:54.092026 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.multi_cell_list [None req-459b5462-58b4-4ed6-8d00-41384bf72c9e tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116864) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 24 09:27:54.188117 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-459b5462-58b4-4ed6-8d00-41384bf72c9e tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] 10.222.0.113 "GET /compute/v2.1/servers" status: 200 len: 345 microversion: 2.1 time: 0.207269 Jan 24 09:27:54.188711 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 623/1243] 10.222.0.113 () {58 vars in 1129 bytes} [Mon Jan 24 09:27:53 2022] GET /compute/v2.1/servers => generated 345 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:27:54.199657 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-dffa7a7d-ed00-4902-9439-e203feb19464 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:27:54.200266 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-dffa7a7d-ed00-4902-9439-e203feb19464 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] [instance: caa08f39-54c9-4b4c-8c4d-03ebefd457f6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:27:54.206122 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-dffa7a7d-ed00-4902-9439-e203feb19464 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:54.206584 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-dffa7a7d-ed00-4902-9439-e203feb19464 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:54.207354 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-dffa7a7d-ed00-4902-9439-e203feb19464 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:54.207795 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-dffa7a7d-ed00-4902-9439-e203feb19464 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:54.342067 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-dffa7a7d-ed00-4902-9439-e203feb19464 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acbca956188435bbf7de9480600bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85801034a13431ebec2bd7a46843d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:27:54.349625 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-dffa7a7d-ed00-4902-9439-e203feb19464 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] 10.222.0.113 "GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6" status: 200 len: 1553 microversion: 2.1 time: 0.154551 Jan 24 09:27:54.350244 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 621/1244] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:27:54 2022] GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6 => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:27:56.180453 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-0e0ccad1-909d-4391-b13e-4bf49334b0cd tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c6c918a-1fa6-4fae-be63-51eee766a57f"}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:27:56.181524 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-0e0ccad1-909d-4391-b13e-4bf49334b0cd tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] [instance: caa08f39-54c9-4b4c-8c4d-03ebefd457f6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:27:56.187804 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0e0ccad1-909d-4391-b13e-4bf49334b0cd tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:56.188250 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0e0ccad1-909d-4391-b13e-4bf49334b0cd tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:56.189021 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0e0ccad1-909d-4391-b13e-4bf49334b0cd tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:27:56.189452 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0e0ccad1-909d-4391-b13e-4bf49334b0cd tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:27:56.923226 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-0e0ccad1-909d-4391-b13e-4bf49334b0cd tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] 10.222.0.113 "POST /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.747090 Jan 24 09:27:56.924020 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 624/1245] 10.222.0.113 () {60 vars in 1327 bytes} [Mon Jan 24 09:27:56 2022] POST /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6/os-volume_attachments => generated 194 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:28:04.443217 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-d6c64332-db2b-4d7f-8b77-f8c3f842a08e tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:28:04.443217 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-d6c64332-db2b-4d7f-8b77-f8c3f842a08e tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] [instance: caa08f39-54c9-4b4c-8c4d-03ebefd457f6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:28:04.448280 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d6c64332-db2b-4d7f-8b77-f8c3f842a08e tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:04.448725 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d6c64332-db2b-4d7f-8b77-f8c3f842a08e tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:04.449509 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d6c64332-db2b-4d7f-8b77-f8c3f842a08e tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:04.449946 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-d6c64332-db2b-4d7f-8b77-f8c3f842a08e tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:04.593207 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-d6c64332-db2b-4d7f-8b77-f8c3f842a08e tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acbca956188435bbf7de9480600bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85801034a13431ebec2bd7a46843d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:28:04.601089 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-d6c64332-db2b-4d7f-8b77-f8c3f842a08e tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] 10.222.0.113 "GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6" status: 200 len: 1599 microversion: 2.1 time: 0.163068 Jan 24 09:28:04.601663 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 622/1246] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:28:04 2022] GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6 => generated 1599 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:28:07.056414 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [req-2e348277-10a2-48c2-8551-6630713bb699 req-2ccf124e-8491-4e50-b853-ba135f653470 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caa08f39-54c9-4b4c-8c4d-03ebefd457f6", "tag": "07a87910-5cf2-42f0-b095-d0bea4cd1a88"}]} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:28:07.066120 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:28:07.066120 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: warnings.warn(msg) Jan 24 09:28:07.074782 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-2e348277-10a2-48c2-8551-6630713bb699 req-2ccf124e-8491-4e50-b853-ba135f653470 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:07.075630 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-2e348277-10a2-48c2-8551-6630713bb699 req-2ccf124e-8491-4e50-b853-ba135f653470 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:07.087744 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.compute.server_external_events [req-2e348277-10a2-48c2-8551-6630713bb699 req-2ccf124e-8491-4e50-b853-ba135f653470 service nova] Creating event network-changed:07a87910-5cf2-42f0-b095-d0bea4cd1a88 for instance caa08f39-54c9-4b4c-8c4d-03ebefd457f6 on hv-cinder-80403 Jan 24 09:28:07.093270 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [req-2e348277-10a2-48c2-8551-6630713bb699 req-2ccf124e-8491-4e50-b853-ba135f653470 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040799 Jan 24 09:28:07.094303 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 625/1247] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:28:09.586844 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-01dd3477-e24e-4bfd-9a40-ad8478fb855f tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1922473447"}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:28:09.587412 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-01dd3477-e24e-4bfd-9a40-ad8478fb855f tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] [instance: caa08f39-54c9-4b4c-8c4d-03ebefd457f6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:28:09.594489 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-01dd3477-e24e-4bfd-9a40-ad8478fb855f tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:09.594943 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-01dd3477-e24e-4bfd-9a40-ad8478fb855f tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:09.595738 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-01dd3477-e24e-4bfd-9a40-ad8478fb855f tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:09.596174 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-01dd3477-e24e-4bfd-9a40-ad8478fb855f tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:09.731068 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.network.security_group_api [None req-01dd3477-e24e-4bfd-9a40-ad8478fb855f tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Adding security group 4ebe2826-6559-48f0-b3f0-c406e7526152 to port 07a87910-5cf2-42f0-b095-d0bea4cd1a88 Jan 24 09:28:10.169551 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-01dd3477-e24e-4bfd-9a40-ad8478fb855f tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] 10.222.0.113 "POST /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6/action" status: 202 len: 0 microversion: 2.1 time: 0.586397 Jan 24 09:28:10.171157 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 623/1248] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:28:09 2022] POST /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6/action => generated 0 bytes in 589 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:28:10.179648 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-62e5a070-7d60-41c2-afc6-12015c418706 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:28:10.179966 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [req-9856b2c5-1c1a-4bf8-af82-94c586387952 req-1aaa1365-3779-41f4-b3bc-bfa7d9e13658 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caa08f39-54c9-4b4c-8c4d-03ebefd457f6", "tag": "07a87910-5cf2-42f0-b095-d0bea4cd1a88"}]} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:28:10.180501 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-62e5a070-7d60-41c2-afc6-12015c418706 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] [instance: caa08f39-54c9-4b4c-8c4d-03ebefd457f6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:28:10.181366 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:28:10.181366 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: warnings.warn(msg) Jan 24 09:28:10.193922 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-62e5a070-7d60-41c2-afc6-12015c418706 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:10.194572 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-62e5a070-7d60-41c2-afc6-12015c418706 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:10.195166 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-62e5a070-7d60-41c2-afc6-12015c418706 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:10.198437 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-9856b2c5-1c1a-4bf8-af82-94c586387952 req-1aaa1365-3779-41f4-b3bc-bfa7d9e13658 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:10.199170 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-9856b2c5-1c1a-4bf8-af82-94c586387952 req-1aaa1365-3779-41f4-b3bc-bfa7d9e13658 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:10.199311 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-62e5a070-7d60-41c2-afc6-12015c418706 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:10.211960 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.compute.server_external_events [req-9856b2c5-1c1a-4bf8-af82-94c586387952 req-1aaa1365-3779-41f4-b3bc-bfa7d9e13658 service nova] Creating event network-changed:07a87910-5cf2-42f0-b095-d0bea4cd1a88 for instance caa08f39-54c9-4b4c-8c4d-03ebefd457f6 on hv-cinder-80403 Jan 24 09:28:10.220539 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [req-9856b2c5-1c1a-4bf8-af82-94c586387952 req-1aaa1365-3779-41f4-b3bc-bfa7d9e13658 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046123 Jan 24 09:28:10.222367 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 626/1249] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:28:10.480761 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-62e5a070-7d60-41c2-afc6-12015c418706 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acbca956188435bbf7de9480600bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85801034a13431ebec2bd7a46843d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:28:10.487640 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-62e5a070-7d60-41c2-afc6-12015c418706 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] 10.222.0.113 "GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6" status: 200 len: 1763 microversion: 2.1 time: 0.311526 Jan 24 09:28:10.488230 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 624/1250] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:28:10 2022] GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6 => generated 1763 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:28:12.184698 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-432cba11-d0b1-49ab-b466-356a52c47776 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:28:12.185290 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-432cba11-d0b1-49ab-b466-356a52c47776 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: 4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:28:12.191385 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-432cba11-d0b1-49ab-b466-356a52c47776 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:12.191840 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-432cba11-d0b1-49ab-b466-356a52c47776 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:12.192682 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-432cba11-d0b1-49ab-b466-356a52c47776 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:12.193129 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-432cba11-d0b1-49ab-b466-356a52c47776 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:12.217628 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-432cba11-d0b1-49ab-b466-356a52c47776 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: 4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89] Going to try to terminate instance {{(pid=116864) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 09:28:12.238886 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [req-2191bcbb-c06b-4e8e-9c1c-ad1d8886b8bf req-6318ac9e-7ff9-47d2-adce-947254052f89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89", "tag": "3c096b5a-bed1-485d-924a-31c2ba638b87"}]} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:28:12.240542 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:28:12.240542 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: warnings.warn(msg) Jan 24 09:28:12.249912 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-2191bcbb-c06b-4e8e-9c1c-ad1d8886b8bf req-6318ac9e-7ff9-47d2-adce-947254052f89 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:12.251344 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-2191bcbb-c06b-4e8e-9c1c-ad1d8886b8bf req-6318ac9e-7ff9-47d2-adce-947254052f89 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:12.262863 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.compute.server_external_events [req-2191bcbb-c06b-4e8e-9c1c-ad1d8886b8bf req-6318ac9e-7ff9-47d2-adce-947254052f89 service nova] Creating event network-changed:3c096b5a-bed1-485d-924a-31c2ba638b87 for instance 4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89 on hv-cinder-80403 Jan 24 09:28:12.268141 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [req-2191bcbb-c06b-4e8e-9c1c-ad1d8886b8bf req-6318ac9e-7ff9-47d2-adce-947254052f89 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032849 Jan 24 09:28:12.268927 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 625/1251] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:28:12.507585 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-432cba11-d0b1-49ab-b466-356a52c47776 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "DELETE /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89" status: 204 len: 0 microversion: 2.1 time: 0.327672 Jan 24 09:28:12.508181 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 627/1252] 10.222.0.113 () {58 vars in 1243 bytes} [Mon Jan 24 09:28:12 2022] DELETE /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 24 09:28:12.517229 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-33197e4c-4bf5-441b-84d2-24c3ae19c7fc tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:28:12.519820 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-33197e4c-4bf5-441b-84d2-24c3ae19c7fc tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: 4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:28:12.524427 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-33197e4c-4bf5-441b-84d2-24c3ae19c7fc tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:12.524950 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-33197e4c-4bf5-441b-84d2-24c3ae19c7fc tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:12.526499 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-33197e4c-4bf5-441b-84d2-24c3ae19c7fc tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:12.527078 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-33197e4c-4bf5-441b-84d2-24c3ae19c7fc tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:12.747571 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-33197e4c-4bf5-441b-84d2-24c3ae19c7fc tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:28:12.755882 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-33197e4c-4bf5-441b-84d2-24c3ae19c7fc tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89" status: 200 len: 1581 microversion: 2.1 time: 0.242594 Jan 24 09:28:12.756723 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 626/1253] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:28:12 2022] GET /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89 => generated 1581 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:28:13.774816 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-b366db7c-c73f-49b6-b1bb-8eae91096c07 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:28:13.776085 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-b366db7c-c73f-49b6-b1bb-8eae91096c07 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: 4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:28:13.783166 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b366db7c-c73f-49b6-b1bb-8eae91096c07 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:13.783629 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b366db7c-c73f-49b6-b1bb-8eae91096c07 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:13.784419 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b366db7c-c73f-49b6-b1bb-8eae91096c07 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:13.784860 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b366db7c-c73f-49b6-b1bb-8eae91096c07 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:13.924633 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-b366db7c-c73f-49b6-b1bb-8eae91096c07 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:28:13.933707 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-b366db7c-c73f-49b6-b1bb-8eae91096c07 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89" status: 200 len: 1462 microversion: 2.1 time: 0.162790 Jan 24 09:28:13.934434 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 628/1254] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:28:13 2022] GET /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89 => generated 1462 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:28:14.951446 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-ec3a354a-40cb-42a1-a9d7-8ce6d19269a7 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:28:14.951998 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-ec3a354a-40cb-42a1-a9d7-8ce6d19269a7 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: 4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:28:14.958502 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ec3a354a-40cb-42a1-a9d7-8ce6d19269a7 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:14.958957 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ec3a354a-40cb-42a1-a9d7-8ce6d19269a7 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:14.959766 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ec3a354a-40cb-42a1-a9d7-8ce6d19269a7 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:14.960269 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ec3a354a-40cb-42a1-a9d7-8ce6d19269a7 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:15.121975 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-ec3a354a-40cb-42a1-a9d7-8ce6d19269a7 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:28:15.130001 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-ec3a354a-40cb-42a1-a9d7-8ce6d19269a7 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89" status: 200 len: 1462 microversion: 2.1 time: 0.182832 Jan 24 09:28:15.130629 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 627/1255] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:28:14 2022] GET /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89 => generated 1462 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:28:15.226189 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [req-dc308ea8-c0ae-47df-ba48-1fc6114e7261 req-1f6eef34-f104-4d76-a5b4-09641024b295 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89", "name": "network-vif-deleted", "tag": "3c096b5a-bed1-485d-924a-31c2ba638b87"}]} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:28:15.227738 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:28:15.227738 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: warnings.warn(msg) Jan 24 09:28:15.236061 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-dc308ea8-c0ae-47df-ba48-1fc6114e7261 req-1f6eef34-f104-4d76-a5b4-09641024b295 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:15.236512 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-dc308ea8-c0ae-47df-ba48-1fc6114e7261 req-1f6eef34-f104-4d76-a5b4-09641024b295 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:15.248073 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.compute.server_external_events [req-dc308ea8-c0ae-47df-ba48-1fc6114e7261 req-1f6eef34-f104-4d76-a5b4-09641024b295 service nova] Creating event network-vif-deleted:3c096b5a-bed1-485d-924a-31c2ba638b87 for instance 4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89 on hv-cinder-80403 Jan 24 09:28:15.253111 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [req-dc308ea8-c0ae-47df-ba48-1fc6114e7261 req-1f6eef34-f104-4d76-a5b4-09641024b295 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030580 Jan 24 09:28:15.253737 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 629/1256] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:28:16.149664 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-93f20868-45f5-4006-b2b5-eefa9bbc1812 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:28:16.150586 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-93f20868-45f5-4006-b2b5-eefa9bbc1812 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: 4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:28:16.157106 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-93f20868-45f5-4006-b2b5-eefa9bbc1812 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:16.157546 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-93f20868-45f5-4006-b2b5-eefa9bbc1812 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:16.158351 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-93f20868-45f5-4006-b2b5-eefa9bbc1812 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:16.158781 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-93f20868-45f5-4006-b2b5-eefa9bbc1812 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:16.191715 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-93f20868-45f5-4006-b2b5-eefa9bbc1812 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:16.192158 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-93f20868-45f5-4006-b2b5-eefa9bbc1812 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:16.192601 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.objects.instance [None req-93f20868-45f5-4006-b2b5-eefa9bbc1812 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lazy-loading 'fault' on Instance uuid 4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89 {{(pid=116863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 09:28:16.233606 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-93f20868-45f5-4006-b2b5-eefa9bbc1812 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:28:16.241426 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-93f20868-45f5-4006-b2b5-eefa9bbc1812 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89" status: 200 len: 1233 microversion: 2.1 time: 0.095326 Jan 24 09:28:16.242001 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 628/1257] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:28:16 2022] GET /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89 => generated 1233 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:28:17.263246 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-47a99050-d6a7-4044-a517-0bb307988e9f tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:28:17.263978 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-47a99050-d6a7-4044-a517-0bb307988e9f tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: 4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:28:17.271316 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-47a99050-d6a7-4044-a517-0bb307988e9f tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:17.271795 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-47a99050-d6a7-4044-a517-0bb307988e9f tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:17.272585 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-47a99050-d6a7-4044-a517-0bb307988e9f tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:17.273025 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-47a99050-d6a7-4044-a517-0bb307988e9f tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:17.286387 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.wsgi [None req-47a99050-d6a7-4044-a517-0bb307988e9f tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] HTTP exception thrown: Instance 4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89 could not be found. Jan 24 09:28:17.286980 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-47a99050-d6a7-4044-a517-0bb307988e9f tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Returning 404 to user: Instance 4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89 could not be found. {{(pid=116864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:28:17.287794 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-47a99050-d6a7-4044-a517-0bb307988e9f tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89" status: 404 len: 111 microversion: 2.1 time: 0.028670 Jan 24 09:28:17.288339 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 630/1258] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:28:17 2022] GET /compute/v2.1/servers/4ba6158f-049e-4d1b-8ef2-0ceb1bd9ec89 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 09:28:20.730998 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-6c577507-38b9-4267-b730-516611799f88 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:28:20.731534 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-6c577507-38b9-4267-b730-516611799f88 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f32748bf-320b-4cb5-9616-7c1d7260e260] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:28:20.738310 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6c577507-38b9-4267-b730-516611799f88 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:20.738755 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6c577507-38b9-4267-b730-516611799f88 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:20.744002 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6c577507-38b9-4267-b730-516611799f88 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:20.744463 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-6c577507-38b9-4267-b730-516611799f88 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:20.771937 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-6c577507-38b9-4267-b730-516611799f88 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f32748bf-320b-4cb5-9616-7c1d7260e260] Going to try to terminate instance {{(pid=116863) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 09:28:20.801124 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [req-41db8225-83c8-4b51-ba72-69e77592b04b req-c90aa80a-8abc-4615-b758-8e0d3415390e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f32748bf-320b-4cb5-9616-7c1d7260e260", "tag": "5759d870-5446-4073-a6bb-068adfd04ca4"}]} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:28:20.803463 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:28:20.803463 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: warnings.warn(msg) Jan 24 09:28:20.812728 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-41db8225-83c8-4b51-ba72-69e77592b04b req-c90aa80a-8abc-4615-b758-8e0d3415390e service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:20.813063 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-41db8225-83c8-4b51-ba72-69e77592b04b req-c90aa80a-8abc-4615-b758-8e0d3415390e service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:20.826583 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.compute.server_external_events [req-41db8225-83c8-4b51-ba72-69e77592b04b req-c90aa80a-8abc-4615-b758-8e0d3415390e service nova] Creating event network-changed:5759d870-5446-4073-a6bb-068adfd04ca4 for instance f32748bf-320b-4cb5-9616-7c1d7260e260 on hv-cinder-80403 Jan 24 09:28:20.832042 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [req-41db8225-83c8-4b51-ba72-69e77592b04b req-c90aa80a-8abc-4615-b758-8e0d3415390e service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101375 Jan 24 09:28:20.832922 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 631/1259] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:28:21.107989 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-6c577507-38b9-4267-b730-516611799f88 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "DELETE /compute/v2.1/servers/f32748bf-320b-4cb5-9616-7c1d7260e260" status: 204 len: 0 microversion: 2.1 time: 0.380434 Jan 24 09:28:21.108656 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 629/1260] 10.222.0.113 () {58 vars in 1243 bytes} [Mon Jan 24 09:28:20 2022] DELETE /compute/v2.1/servers/f32748bf-320b-4cb5-9616-7c1d7260e260 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 24 09:28:21.117231 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-08097466-543c-48b3-a74e-87666a2dc175 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:28:21.117939 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-08097466-543c-48b3-a74e-87666a2dc175 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f32748bf-320b-4cb5-9616-7c1d7260e260] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:28:21.125271 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-08097466-543c-48b3-a74e-87666a2dc175 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:21.125719 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-08097466-543c-48b3-a74e-87666a2dc175 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:21.126555 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-08097466-543c-48b3-a74e-87666a2dc175 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:21.126990 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-08097466-543c-48b3-a74e-87666a2dc175 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:21.273058 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-08097466-543c-48b3-a74e-87666a2dc175 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:28:21.283436 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-08097466-543c-48b3-a74e-87666a2dc175 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/f32748bf-320b-4cb5-9616-7c1d7260e260" status: 200 len: 1582 microversion: 2.1 time: 0.170122 Jan 24 09:28:21.284397 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 632/1261] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:28:21 2022] GET /compute/v2.1/servers/f32748bf-320b-4cb5-9616-7c1d7260e260 => generated 1582 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:28:22.304706 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-b14d9cb8-0ebd-42b8-adee-8df45242aa31 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:28:22.305540 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-b14d9cb8-0ebd-42b8-adee-8df45242aa31 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f32748bf-320b-4cb5-9616-7c1d7260e260] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:28:22.312626 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b14d9cb8-0ebd-42b8-adee-8df45242aa31 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:22.313078 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b14d9cb8-0ebd-42b8-adee-8df45242aa31 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:22.313859 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b14d9cb8-0ebd-42b8-adee-8df45242aa31 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:22.314326 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b14d9cb8-0ebd-42b8-adee-8df45242aa31 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:22.452924 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-b14d9cb8-0ebd-42b8-adee-8df45242aa31 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:28:22.460584 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-b14d9cb8-0ebd-42b8-adee-8df45242aa31 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/f32748bf-320b-4cb5-9616-7c1d7260e260" status: 200 len: 1463 microversion: 2.1 time: 0.159961 Jan 24 09:28:22.461164 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 630/1262] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:28:22 2022] GET /compute/v2.1/servers/f32748bf-320b-4cb5-9616-7c1d7260e260 => generated 1463 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:28:23.478444 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-e462f19a-aaa0-4c8b-b7e7-6fbd8425e060 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:28:23.481290 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-e462f19a-aaa0-4c8b-b7e7-6fbd8425e060 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f32748bf-320b-4cb5-9616-7c1d7260e260] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:28:23.496979 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e462f19a-aaa0-4c8b-b7e7-6fbd8425e060 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:23.497834 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e462f19a-aaa0-4c8b-b7e7-6fbd8425e060 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:23.498255 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e462f19a-aaa0-4c8b-b7e7-6fbd8425e060 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:23.498743 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e462f19a-aaa0-4c8b-b7e7-6fbd8425e060 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:23.565277 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [req-a99c9e0e-1fe7-45a9-9a0d-c584bdf38b03 req-05b3617c-bfee-4a49-b0bd-0f3ac30ee423 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f32748bf-320b-4cb5-9616-7c1d7260e260", "name": "network-vif-deleted", "tag": "5759d870-5446-4073-a6bb-068adfd04ca4"}]} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:28:23.566829 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:28:23.566829 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: warnings.warn(msg) Jan 24 09:28:23.570571 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-e462f19a-aaa0-4c8b-b7e7-6fbd8425e060 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:28:23.575091 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-a99c9e0e-1fe7-45a9-9a0d-c584bdf38b03 req-05b3617c-bfee-4a49-b0bd-0f3ac30ee423 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:23.575665 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-a99c9e0e-1fe7-45a9-9a0d-c584bdf38b03 req-05b3617c-bfee-4a49-b0bd-0f3ac30ee423 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:23.579989 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-e462f19a-aaa0-4c8b-b7e7-6fbd8425e060 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/f32748bf-320b-4cb5-9616-7c1d7260e260" status: 200 len: 1395 microversion: 2.1 time: 0.105772 Jan 24 09:28:23.580573 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 633/1263] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:28:23 2022] GET /compute/v2.1/servers/f32748bf-320b-4cb5-9616-7c1d7260e260 => generated 1395 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:28:23.587409 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.compute.server_external_events [req-a99c9e0e-1fe7-45a9-9a0d-c584bdf38b03 req-05b3617c-bfee-4a49-b0bd-0f3ac30ee423 service nova] Creating event network-vif-deleted:5759d870-5446-4073-a6bb-068adfd04ca4 for instance f32748bf-320b-4cb5-9616-7c1d7260e260 on hv-cinder-80403 Jan 24 09:28:23.592977 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [req-a99c9e0e-1fe7-45a9-9a0d-c584bdf38b03 req-05b3617c-bfee-4a49-b0bd-0f3ac30ee423 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031341 Jan 24 09:28:23.595843 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 631/1264] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 09:28:24.597913 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-39768d85-8aee-49dc-8d0c-02e1d7b3ac86 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:28:24.598724 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-39768d85-8aee-49dc-8d0c-02e1d7b3ac86 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f32748bf-320b-4cb5-9616-7c1d7260e260] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:28:24.606203 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-39768d85-8aee-49dc-8d0c-02e1d7b3ac86 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:24.606662 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-39768d85-8aee-49dc-8d0c-02e1d7b3ac86 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:24.607533 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-39768d85-8aee-49dc-8d0c-02e1d7b3ac86 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:24.607971 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-39768d85-8aee-49dc-8d0c-02e1d7b3ac86 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:24.637708 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-39768d85-8aee-49dc-8d0c-02e1d7b3ac86 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:24.638172 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-39768d85-8aee-49dc-8d0c-02e1d7b3ac86 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:24.638627 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.objects.instance [None req-39768d85-8aee-49dc-8d0c-02e1d7b3ac86 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lazy-loading 'fault' on Instance uuid f32748bf-320b-4cb5-9616-7c1d7260e260 {{(pid=116864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 09:28:24.678287 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-39768d85-8aee-49dc-8d0c-02e1d7b3ac86 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91399ccc8ba64dc7becff56785e9b904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaa9b436ab45108aa33633b17e58d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:28:24.685913 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-39768d85-8aee-49dc-8d0c-02e1d7b3ac86 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/f32748bf-320b-4cb5-9616-7c1d7260e260" status: 200 len: 1233 microversion: 2.1 time: 0.091707 Jan 24 09:28:24.686529 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 634/1265] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:28:24 2022] GET /compute/v2.1/servers/f32748bf-320b-4cb5-9616-7c1d7260e260 => generated 1233 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:28:25.704692 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-00e5a87b-2985-4748-82b0-7a7c5eac6dce tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:28:25.705309 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-00e5a87b-2985-4748-82b0-7a7c5eac6dce tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f32748bf-320b-4cb5-9616-7c1d7260e260] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:28:25.711403 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-00e5a87b-2985-4748-82b0-7a7c5eac6dce tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:25.711854 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-00e5a87b-2985-4748-82b0-7a7c5eac6dce tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:25.712629 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-00e5a87b-2985-4748-82b0-7a7c5eac6dce tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:25.713069 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-00e5a87b-2985-4748-82b0-7a7c5eac6dce tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:25.726707 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.wsgi [None req-00e5a87b-2985-4748-82b0-7a7c5eac6dce tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] HTTP exception thrown: Instance f32748bf-320b-4cb5-9616-7c1d7260e260 could not be found. Jan 24 09:28:25.727300 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-00e5a87b-2985-4748-82b0-7a7c5eac6dce tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Returning 404 to user: Instance f32748bf-320b-4cb5-9616-7c1d7260e260 could not be found. {{(pid=116863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:28:25.728118 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-00e5a87b-2985-4748-82b0-7a7c5eac6dce tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/f32748bf-320b-4cb5-9616-7c1d7260e260" status: 404 len: 111 microversion: 2.1 time: 0.028042 Jan 24 09:28:25.728651 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 632/1266] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:28:25 2022] GET /compute/v2.1/servers/f32748bf-320b-4cb5-9616-7c1d7260e260 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 24 09:28:26.240605 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-c7a8aa83-8603-428f-9cbb-1846f5186cdd tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:28:26.241111 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-c7a8aa83-8603-428f-9cbb-1846f5186cdd tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f31eba5c-d268-48b8-8d66-c1da93154cc4] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:28:26.247422 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c7a8aa83-8603-428f-9cbb-1846f5186cdd tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:26.247879 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c7a8aa83-8603-428f-9cbb-1846f5186cdd tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:26.248654 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c7a8aa83-8603-428f-9cbb-1846f5186cdd tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:26.249092 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-c7a8aa83-8603-428f-9cbb-1846f5186cdd tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:26.262213 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.wsgi [None req-c7a8aa83-8603-428f-9cbb-1846f5186cdd tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] HTTP exception thrown: Instance f31eba5c-d268-48b8-8d66-c1da93154cc4 could not be found. Jan 24 09:28:26.262805 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-c7a8aa83-8603-428f-9cbb-1846f5186cdd tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Returning 404 to user: Instance f31eba5c-d268-48b8-8d66-c1da93154cc4 could not be found. {{(pid=116864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:28:26.263637 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-c7a8aa83-8603-428f-9cbb-1846f5186cdd tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "DELETE /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4" status: 404 len: 111 microversion: 2.1 time: 0.026781 Jan 24 09:28:26.264180 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 635/1267] 10.222.0.113 () {58 vars in 1243 bytes} [Mon Jan 24 09:28:26 2022] DELETE /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 09:28:26.272336 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-13049206-0e0c-4d44-b06b-77d6c5b8f069 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:28:26.272945 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-13049206-0e0c-4d44-b06b-77d6c5b8f069 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] [instance: f31eba5c-d268-48b8-8d66-c1da93154cc4] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:28:26.279864 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-13049206-0e0c-4d44-b06b-77d6c5b8f069 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:26.280566 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-13049206-0e0c-4d44-b06b-77d6c5b8f069 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:26.281341 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-13049206-0e0c-4d44-b06b-77d6c5b8f069 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:26.281776 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-13049206-0e0c-4d44-b06b-77d6c5b8f069 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:26.295584 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.wsgi [None req-13049206-0e0c-4d44-b06b-77d6c5b8f069 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] HTTP exception thrown: Instance f31eba5c-d268-48b8-8d66-c1da93154cc4 could not be found. Jan 24 09:28:26.296163 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-13049206-0e0c-4d44-b06b-77d6c5b8f069 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Returning 404 to user: Instance f31eba5c-d268-48b8-8d66-c1da93154cc4 could not be found. {{(pid=116863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:28:26.296974 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-13049206-0e0c-4d44-b06b-77d6c5b8f069 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4" status: 404 len: 111 microversion: 2.1 time: 0.028356 Jan 24 09:28:26.297507 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 633/1268] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:28:26 2022] GET /compute/v2.1/servers/f31eba5c-d268-48b8-8d66-c1da93154cc4 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 09:28:27.810081 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-a019ad02-bc87-43c1-bafa-357938ba5121 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] Calling method '.version_select at 0x7f473d5a1820>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:28:27.885113 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-a019ad02-bc87-43c1-bafa-357938ba5121 tempest-TestVolumeBootPattern-1690709088 tempest-TestVolumeBootPattern-1690709088-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-760537949" status: 202 len: 0 microversion: 2.1 time: 0.079634 Jan 24 09:28:27.886356 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 636/1269] 10.222.0.113 () {58 vars in 1264 bytes} [Mon Jan 24 09:28:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-760537949 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:28:36.022504 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-b2327266-0755-46b6-b5b4-91db4c961b6e tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:28:36.023449 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-b2327266-0755-46b6-b5b4-91db4c961b6e tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] [instance: caa08f39-54c9-4b4c-8c4d-03ebefd457f6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:28:36.029294 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b2327266-0755-46b6-b5b4-91db4c961b6e tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:36.030010 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b2327266-0755-46b6-b5b4-91db4c961b6e tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:36.030810 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b2327266-0755-46b6-b5b4-91db4c961b6e tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:36.031245 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b2327266-0755-46b6-b5b4-91db4c961b6e tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:36.458997 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-b2327266-0755-46b6-b5b4-91db4c961b6e tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] 10.222.0.113 "POST /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6/action" status: 202 len: 0 microversion: 2.1 time: 0.441244 Jan 24 09:28:36.459884 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 634/1270] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:28:36 2022] POST /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6/action => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:28:36.469395 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-fc046b0c-5c15-4779-af8c-e3f80068be36 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:28:36.470214 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-fc046b0c-5c15-4779-af8c-e3f80068be36 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] [instance: caa08f39-54c9-4b4c-8c4d-03ebefd457f6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:28:36.476816 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fc046b0c-5c15-4779-af8c-e3f80068be36 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:36.478731 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fc046b0c-5c15-4779-af8c-e3f80068be36 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:36.478731 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fc046b0c-5c15-4779-af8c-e3f80068be36 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:36.478731 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fc046b0c-5c15-4779-af8c-e3f80068be36 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:36.632504 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-fc046b0c-5c15-4779-af8c-e3f80068be36 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acbca956188435bbf7de9480600bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85801034a13431ebec2bd7a46843d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:28:36.645918 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-fc046b0c-5c15-4779-af8c-e3f80068be36 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] 10.222.0.113 "GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6" status: 200 len: 1755 microversion: 2.1 time: 0.176869 Jan 24 09:28:36.645918 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 637/1271] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:28:36 2022] GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6 => generated 1755 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:28:37.660405 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-b5d5ab6f-80cb-4a0a-88bd-a75cb0ca7dcb tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:28:37.661114 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-b5d5ab6f-80cb-4a0a-88bd-a75cb0ca7dcb tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] [instance: caa08f39-54c9-4b4c-8c4d-03ebefd457f6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:28:37.668003 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b5d5ab6f-80cb-4a0a-88bd-a75cb0ca7dcb tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:37.668454 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b5d5ab6f-80cb-4a0a-88bd-a75cb0ca7dcb tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:37.669249 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b5d5ab6f-80cb-4a0a-88bd-a75cb0ca7dcb tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:37.669684 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-b5d5ab6f-80cb-4a0a-88bd-a75cb0ca7dcb tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:37.821978 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-b5d5ab6f-80cb-4a0a-88bd-a75cb0ca7dcb tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acbca956188435bbf7de9480600bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85801034a13431ebec2bd7a46843d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:28:37.830494 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-b5d5ab6f-80cb-4a0a-88bd-a75cb0ca7dcb tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] 10.222.0.113 "GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6" status: 200 len: 1760 microversion: 2.1 time: 0.174232 Jan 24 09:28:37.831068 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 635/1272] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:28:37 2022] GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6 => generated 1760 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:28:38.848611 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-092e5a44-5332-4dc0-a903-e3fabd6f44c4 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:28:38.849208 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-092e5a44-5332-4dc0-a903-e3fabd6f44c4 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] [instance: caa08f39-54c9-4b4c-8c4d-03ebefd457f6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:28:38.855692 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-092e5a44-5332-4dc0-a903-e3fabd6f44c4 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:38.856141 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-092e5a44-5332-4dc0-a903-e3fabd6f44c4 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:38.856922 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-092e5a44-5332-4dc0-a903-e3fabd6f44c4 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:38.857359 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-092e5a44-5332-4dc0-a903-e3fabd6f44c4 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:38.997475 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-092e5a44-5332-4dc0-a903-e3fabd6f44c4 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acbca956188435bbf7de9480600bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85801034a13431ebec2bd7a46843d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:28:39.005255 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-092e5a44-5332-4dc0-a903-e3fabd6f44c4 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] 10.222.0.113 "GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6" status: 200 len: 1760 microversion: 2.1 time: 0.160304 Jan 24 09:28:39.005831 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 638/1273] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:28:38 2022] GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6 => generated 1760 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:28:40.022249 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-3fabeac3-edc2-4d7b-9a50-9e078e4bdeec tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:28:40.022849 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-3fabeac3-edc2-4d7b-9a50-9e078e4bdeec tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] [instance: caa08f39-54c9-4b4c-8c4d-03ebefd457f6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:28:40.030332 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3fabeac3-edc2-4d7b-9a50-9e078e4bdeec tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:40.030782 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3fabeac3-edc2-4d7b-9a50-9e078e4bdeec tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:40.031562 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3fabeac3-edc2-4d7b-9a50-9e078e4bdeec tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:40.032001 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-3fabeac3-edc2-4d7b-9a50-9e078e4bdeec tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:40.171831 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-3fabeac3-edc2-4d7b-9a50-9e078e4bdeec tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acbca956188435bbf7de9480600bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85801034a13431ebec2bd7a46843d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:28:40.179468 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-3fabeac3-edc2-4d7b-9a50-9e078e4bdeec tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] 10.222.0.113 "GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6" status: 200 len: 1760 microversion: 2.1 time: 0.160917 Jan 24 09:28:40.180156 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 636/1274] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:28:40 2022] GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6 => generated 1760 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:28:41.196654 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-f16ce1ec-d9a3-4c4f-83fa-61a1cf9713f8 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:28:41.197266 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-f16ce1ec-d9a3-4c4f-83fa-61a1cf9713f8 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] [instance: caa08f39-54c9-4b4c-8c4d-03ebefd457f6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:28:41.204241 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f16ce1ec-d9a3-4c4f-83fa-61a1cf9713f8 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:41.204694 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f16ce1ec-d9a3-4c4f-83fa-61a1cf9713f8 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:41.205472 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f16ce1ec-d9a3-4c4f-83fa-61a1cf9713f8 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:41.205908 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f16ce1ec-d9a3-4c4f-83fa-61a1cf9713f8 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:41.344886 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-f16ce1ec-d9a3-4c4f-83fa-61a1cf9713f8 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acbca956188435bbf7de9480600bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85801034a13431ebec2bd7a46843d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:28:41.352607 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-f16ce1ec-d9a3-4c4f-83fa-61a1cf9713f8 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] 10.222.0.113 "GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6" status: 200 len: 1760 microversion: 2.1 time: 0.159638 Jan 24 09:28:41.353170 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 639/1275] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:28:41 2022] GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6 => generated 1760 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:28:42.369899 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-e4220232-00fb-42e7-87ff-62a07ccba640 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:28:42.370532 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-e4220232-00fb-42e7-87ff-62a07ccba640 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] [instance: caa08f39-54c9-4b4c-8c4d-03ebefd457f6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:28:42.377081 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e4220232-00fb-42e7-87ff-62a07ccba640 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:42.377527 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e4220232-00fb-42e7-87ff-62a07ccba640 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:42.378332 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e4220232-00fb-42e7-87ff-62a07ccba640 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:42.378763 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e4220232-00fb-42e7-87ff-62a07ccba640 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:42.524511 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-e4220232-00fb-42e7-87ff-62a07ccba640 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acbca956188435bbf7de9480600bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85801034a13431ebec2bd7a46843d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:28:42.532858 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-e4220232-00fb-42e7-87ff-62a07ccba640 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] 10.222.0.113 "GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6" status: 200 len: 1760 microversion: 2.1 time: 0.166649 Jan 24 09:28:42.533429 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 637/1276] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:28:42 2022] GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6 => generated 1760 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:28:43.549039 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-0028c900-1667-4eb9-9353-6dd9c5c56c18 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:28:43.549628 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-0028c900-1667-4eb9-9353-6dd9c5c56c18 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] [instance: caa08f39-54c9-4b4c-8c4d-03ebefd457f6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:28:43.556260 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0028c900-1667-4eb9-9353-6dd9c5c56c18 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:43.556819 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0028c900-1667-4eb9-9353-6dd9c5c56c18 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:43.557825 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0028c900-1667-4eb9-9353-6dd9c5c56c18 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:43.558321 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0028c900-1667-4eb9-9353-6dd9c5c56c18 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:43.704782 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-0028c900-1667-4eb9-9353-6dd9c5c56c18 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acbca956188435bbf7de9480600bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85801034a13431ebec2bd7a46843d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:28:43.712412 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-0028c900-1667-4eb9-9353-6dd9c5c56c18 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] 10.222.0.113 "GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6" status: 200 len: 1760 microversion: 2.1 time: 0.167035 Jan 24 09:28:43.713071 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 640/1277] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:28:43 2022] GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6 => generated 1760 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:28:44.729769 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-44c43459-e766-4251-8b1a-4b48a2deff82 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:28:44.730336 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-44c43459-e766-4251-8b1a-4b48a2deff82 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] [instance: caa08f39-54c9-4b4c-8c4d-03ebefd457f6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:28:44.736633 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-44c43459-e766-4251-8b1a-4b48a2deff82 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:44.737084 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-44c43459-e766-4251-8b1a-4b48a2deff82 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:44.737862 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-44c43459-e766-4251-8b1a-4b48a2deff82 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:44.738332 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-44c43459-e766-4251-8b1a-4b48a2deff82 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:44.879806 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-44c43459-e766-4251-8b1a-4b48a2deff82 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acbca956188435bbf7de9480600bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85801034a13431ebec2bd7a46843d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:28:44.888262 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-44c43459-e766-4251-8b1a-4b48a2deff82 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] 10.222.0.113 "GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6" status: 200 len: 1760 microversion: 2.1 time: 0.162322 Jan 24 09:28:44.888919 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 638/1278] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:28:44 2022] GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6 => generated 1760 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:28:45.906105 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-0b33430f-e58f-416f-9842-b57157face5b tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:28:45.906810 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-0b33430f-e58f-416f-9842-b57157face5b tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] [instance: caa08f39-54c9-4b4c-8c4d-03ebefd457f6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:28:45.913383 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0b33430f-e58f-416f-9842-b57157face5b tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:45.913840 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0b33430f-e58f-416f-9842-b57157face5b tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:45.914657 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0b33430f-e58f-416f-9842-b57157face5b tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:45.915099 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-0b33430f-e58f-416f-9842-b57157face5b tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:46.060246 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-0b33430f-e58f-416f-9842-b57157face5b tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acbca956188435bbf7de9480600bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85801034a13431ebec2bd7a46843d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:28:46.068030 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-0b33430f-e58f-416f-9842-b57157face5b tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] 10.222.0.113 "GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6" status: 200 len: 1760 microversion: 2.1 time: 0.166633 Jan 24 09:28:46.068595 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 641/1279] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:28:45 2022] GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6 => generated 1760 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:28:47.085023 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-4c4ab954-bcea-40a4-b2d3-5ccd17956c0f tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:28:47.085623 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-4c4ab954-bcea-40a4-b2d3-5ccd17956c0f tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] [instance: caa08f39-54c9-4b4c-8c4d-03ebefd457f6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:28:47.092954 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4c4ab954-bcea-40a4-b2d3-5ccd17956c0f tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:47.093407 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4c4ab954-bcea-40a4-b2d3-5ccd17956c0f tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:47.094219 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4c4ab954-bcea-40a4-b2d3-5ccd17956c0f tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:47.094659 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-4c4ab954-bcea-40a4-b2d3-5ccd17956c0f tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:47.247380 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-4c4ab954-bcea-40a4-b2d3-5ccd17956c0f tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acbca956188435bbf7de9480600bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85801034a13431ebec2bd7a46843d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:28:47.255470 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-4c4ab954-bcea-40a4-b2d3-5ccd17956c0f tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] 10.222.0.113 "GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6" status: 200 len: 1760 microversion: 2.1 time: 0.174176 Jan 24 09:28:47.256048 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 639/1280] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:28:47 2022] GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6 => generated 1760 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:28:48.272158 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-6dd2c647-c6a9-474b-b687-0ef962b052f2 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:28:48.272728 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-6dd2c647-c6a9-474b-b687-0ef962b052f2 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] [instance: caa08f39-54c9-4b4c-8c4d-03ebefd457f6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:28:48.279935 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6dd2c647-c6a9-474b-b687-0ef962b052f2 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:48.280407 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6dd2c647-c6a9-474b-b687-0ef962b052f2 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:48.281240 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6dd2c647-c6a9-474b-b687-0ef962b052f2 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:28:48.281677 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-6dd2c647-c6a9-474b-b687-0ef962b052f2 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:28:48.430509 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-6dd2c647-c6a9-474b-b687-0ef962b052f2 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acbca956188435bbf7de9480600bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85801034a13431ebec2bd7a46843d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:28:48.439081 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-6dd2c647-c6a9-474b-b687-0ef962b052f2 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] 10.222.0.113 "GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6" status: 200 len: 1763 microversion: 2.1 time: 0.170618 Jan 24 09:28:48.439667 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 642/1281] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:28:48 2022] GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6 => generated 1763 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:29:03.969529 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 24 09:29:03.970435 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: Mon Jan 24 09:29:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 24 09:29:24.147015 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-f27fce1a-3499-4456-a56e-d640b57c52f9 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1922473447"}} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:29:24.147739 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-f27fce1a-3499-4456-a56e-d640b57c52f9 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] [instance: caa08f39-54c9-4b4c-8c4d-03ebefd457f6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:29:24.153991 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f27fce1a-3499-4456-a56e-d640b57c52f9 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:24.159731 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f27fce1a-3499-4456-a56e-d640b57c52f9 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:24.159731 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f27fce1a-3499-4456-a56e-d640b57c52f9 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:24.159731 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f27fce1a-3499-4456-a56e-d640b57c52f9 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:24.284721 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.network.security_group_api [None req-f27fce1a-3499-4456-a56e-d640b57c52f9 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Removing security group 4ebe2826-6559-48f0-b3f0-c406e7526152 from port 07a87910-5cf2-42f0-b095-d0bea4cd1a88 Jan 24 09:29:24.700280 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-f27fce1a-3499-4456-a56e-d640b57c52f9 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] 10.222.0.113 "POST /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6/action" status: 202 len: 0 microversion: 2.1 time: 0.557246 Jan 24 09:29:24.702299 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 640/1282] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:29:24 2022] POST /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6/action => generated 0 bytes in 560 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:29:24.709527 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [req-00b4d53b-be66-46d2-a7a2-afdc315883c9 req-2fadd00f-6032-4d15-b972-d34a3a661126 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caa08f39-54c9-4b4c-8c4d-03ebefd457f6", "tag": "07a87910-5cf2-42f0-b095-d0bea4cd1a88"}]} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:29:24.711223 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:29:24.711223 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: warnings.warn(msg) Jan 24 09:29:24.719646 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-00b4d53b-be66-46d2-a7a2-afdc315883c9 req-2fadd00f-6032-4d15-b972-d34a3a661126 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:24.720196 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-00b4d53b-be66-46d2-a7a2-afdc315883c9 req-2fadd00f-6032-4d15-b972-d34a3a661126 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:24.739159 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.compute.server_external_events [req-00b4d53b-be66-46d2-a7a2-afdc315883c9 req-2fadd00f-6032-4d15-b972-d34a3a661126 service nova] Creating event network-changed:07a87910-5cf2-42f0-b095-d0bea4cd1a88 for instance caa08f39-54c9-4b4c-8c4d-03ebefd457f6 on hv-cinder-80403 Jan 24 09:29:24.751291 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [req-00b4d53b-be66-46d2-a7a2-afdc315883c9 req-2fadd00f-6032-4d15-b972-d34a3a661126 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040083 Jan 24 09:29:24.752170 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 643/1283] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 09:29:25.947535 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-33791b4f-48ca-4f7f-8d8d-575d1865821a tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:29:25.948065 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-33791b4f-48ca-4f7f-8d8d-575d1865821a tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] [instance: caa08f39-54c9-4b4c-8c4d-03ebefd457f6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:29:25.948979 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [req-8a89899c-eb61-4a88-a4a2-a4e509587861 req-56c021b4-32eb-4f0b-b691-3178585f7d65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caa08f39-54c9-4b4c-8c4d-03ebefd457f6", "tag": "07a87910-5cf2-42f0-b095-d0bea4cd1a88"}]} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:29:25.951245 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:29:25.951245 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: warnings.warn(msg) Jan 24 09:29:25.955438 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-33791b4f-48ca-4f7f-8d8d-575d1865821a tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:25.955892 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-33791b4f-48ca-4f7f-8d8d-575d1865821a tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:25.956739 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-33791b4f-48ca-4f7f-8d8d-575d1865821a tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:25.957187 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-33791b4f-48ca-4f7f-8d8d-575d1865821a tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:25.959798 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-8a89899c-eb61-4a88-a4a2-a4e509587861 req-56c021b4-32eb-4f0b-b691-3178585f7d65 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:25.960307 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-8a89899c-eb61-4a88-a4a2-a4e509587861 req-56c021b4-32eb-4f0b-b691-3178585f7d65 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:25.973416 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.compute.server_external_events [req-8a89899c-eb61-4a88-a4a2-a4e509587861 req-56c021b4-32eb-4f0b-b691-3178585f7d65 service nova] Creating event network-changed:07a87910-5cf2-42f0-b095-d0bea4cd1a88 for instance caa08f39-54c9-4b4c-8c4d-03ebefd457f6 on hv-cinder-80403 Jan 24 09:29:25.978828 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [req-8a89899c-eb61-4a88-a4a2-a4e509587861 req-56c021b4-32eb-4f0b-b691-3178585f7d65 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033905 Jan 24 09:29:25.979753 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 644/1284] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:29:26.041455 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.objects.instance [None req-33791b4f-48ca-4f7f-8d8d-575d1865821a tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lazy-loading 'services' on Instance uuid caa08f39-54c9-4b4c-8c4d-03ebefd457f6 {{(pid=116863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 09:29:26.241839 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-33791b4f-48ca-4f7f-8d8d-575d1865821a tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] 10.222.0.113 "DELETE /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6/os-volume_attachments/0c6c918a-1fa6-4fae-be63-51eee766a57f" status: 202 len: 0 microversion: 2.1 time: 0.297776 Jan 24 09:29:26.242502 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 641/1285] 10.222.0.113 () {58 vars in 1420 bytes} [Mon Jan 24 09:29:25 2022] DELETE /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6/os-volume_attachments/0c6c918a-1fa6-4fae-be63-51eee766a57f => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:29:26.254445 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-e9d0a362-a747-4af2-948e-99c9b7ebd88d tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:29:26.255639 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-e9d0a362-a747-4af2-948e-99c9b7ebd88d tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] [instance: caa08f39-54c9-4b4c-8c4d-03ebefd457f6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:29:26.263901 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e9d0a362-a747-4af2-948e-99c9b7ebd88d tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:26.264530 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e9d0a362-a747-4af2-948e-99c9b7ebd88d tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:26.265409 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e9d0a362-a747-4af2-948e-99c9b7ebd88d tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:26.266128 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-e9d0a362-a747-4af2-948e-99c9b7ebd88d tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:26.298032 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-e9d0a362-a747-4af2-948e-99c9b7ebd88d tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] 10.222.0.113 "GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050033 Jan 24 09:29:26.298920 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 645/1286] 10.222.0.113 () {58 vars in 1306 bytes} [Mon Jan 24 09:29:26 2022] GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:29:27.311619 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-f0d52a42-34f1-4d07-a6b9-a3f8f0865ac7 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:29:27.312746 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-f0d52a42-34f1-4d07-a6b9-a3f8f0865ac7 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] [instance: caa08f39-54c9-4b4c-8c4d-03ebefd457f6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:29:27.319082 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f0d52a42-34f1-4d07-a6b9-a3f8f0865ac7 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:27.319530 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f0d52a42-34f1-4d07-a6b9-a3f8f0865ac7 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:27.320401 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f0d52a42-34f1-4d07-a6b9-a3f8f0865ac7 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:27.320852 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-f0d52a42-34f1-4d07-a6b9-a3f8f0865ac7 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:27.350806 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-f0d52a42-34f1-4d07-a6b9-a3f8f0865ac7 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] 10.222.0.113 "GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044219 Jan 24 09:29:27.351383 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 642/1287] 10.222.0.113 () {58 vars in 1306 bytes} [Mon Jan 24 09:29:27 2022] GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 09:29:27.361486 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-acc7d132-9ddd-41e9-bc08-8d966cfa4825 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:29:27.362054 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-acc7d132-9ddd-41e9-bc08-8d966cfa4825 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] [instance: caa08f39-54c9-4b4c-8c4d-03ebefd457f6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:29:27.368241 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-acc7d132-9ddd-41e9-bc08-8d966cfa4825 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:27.368694 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-acc7d132-9ddd-41e9-bc08-8d966cfa4825 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:27.369474 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-acc7d132-9ddd-41e9-bc08-8d966cfa4825 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:27.369914 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-acc7d132-9ddd-41e9-bc08-8d966cfa4825 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:27.443257 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.wsgi [None req-acc7d132-9ddd-41e9-bc08-8d966cfa4825 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] HTTP exception thrown: Instance caa08f39-54c9-4b4c-8c4d-03ebefd457f6 is not attached to volume 0c6c918a-1fa6-4fae-be63-51eee766a57f Jan 24 09:29:27.443856 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-acc7d132-9ddd-41e9-bc08-8d966cfa4825 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Returning 404 to user: Instance caa08f39-54c9-4b4c-8c4d-03ebefd457f6 is not attached to volume 0c6c918a-1fa6-4fae-be63-51eee766a57f {{(pid=116864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:29:27.444697 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-acc7d132-9ddd-41e9-bc08-8d966cfa4825 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] 10.222.0.113 "DELETE /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6/os-volume_attachments/0c6c918a-1fa6-4fae-be63-51eee766a57f" status: 404 len: 154 microversion: 2.1 time: 0.087190 Jan 24 09:29:27.445384 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 646/1288] 10.222.0.113 () {58 vars in 1420 bytes} [Mon Jan 24 09:29:27 2022] DELETE /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6/os-volume_attachments/0c6c918a-1fa6-4fae-be63-51eee766a57f => generated 154 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 24 09:29:28.748472 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-961a829e-2978-4f66-a84e-092f25a6011b tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:29:28.749155 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-961a829e-2978-4f66-a84e-092f25a6011b tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] [instance: caa08f39-54c9-4b4c-8c4d-03ebefd457f6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:29:28.755590 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-961a829e-2978-4f66-a84e-092f25a6011b tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:28.756038 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-961a829e-2978-4f66-a84e-092f25a6011b tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:28.756826 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-961a829e-2978-4f66-a84e-092f25a6011b tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:28.757264 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-961a829e-2978-4f66-a84e-092f25a6011b tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:28.781181 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-961a829e-2978-4f66-a84e-092f25a6011b tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] [instance: caa08f39-54c9-4b4c-8c4d-03ebefd457f6] Going to try to terminate instance {{(pid=116863) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 09:29:29.111128 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-961a829e-2978-4f66-a84e-092f25a6011b tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] 10.222.0.113 "DELETE /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6" status: 204 len: 0 microversion: 2.1 time: 0.366587 Jan 24 09:29:29.111863 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 643/1289] 10.222.0.113 () {58 vars in 1243 bytes} [Mon Jan 24 09:29:28 2022] DELETE /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 24 09:29:29.119862 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-dd747c83-260c-407a-9aad-d9d2d1029f3a tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:29:29.120480 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-dd747c83-260c-407a-9aad-d9d2d1029f3a tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] [instance: caa08f39-54c9-4b4c-8c4d-03ebefd457f6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:29:29.127012 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-dd747c83-260c-407a-9aad-d9d2d1029f3a tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:29.127463 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-dd747c83-260c-407a-9aad-d9d2d1029f3a tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:29.128239 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-dd747c83-260c-407a-9aad-d9d2d1029f3a tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:29.128676 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-dd747c83-260c-407a-9aad-d9d2d1029f3a tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:29.261833 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-dd747c83-260c-407a-9aad-d9d2d1029f3a tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acbca956188435bbf7de9480600bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85801034a13431ebec2bd7a46843d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:29:29.270349 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-dd747c83-260c-407a-9aad-d9d2d1029f3a tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] 10.222.0.113 "GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6" status: 200 len: 1559 microversion: 2.1 time: 0.154040 Jan 24 09:29:29.271299 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 647/1290] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:29:29 2022] GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:29:30.289012 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-9187b3dc-671e-46af-ae6a-9a51f31071e5 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:29:30.289723 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-9187b3dc-671e-46af-ae6a-9a51f31071e5 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] [instance: caa08f39-54c9-4b4c-8c4d-03ebefd457f6] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:29:30.296660 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9187b3dc-671e-46af-ae6a-9a51f31071e5 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:30.297111 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9187b3dc-671e-46af-ae6a-9a51f31071e5 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:30.297891 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9187b3dc-671e-46af-ae6a-9a51f31071e5 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:30.298361 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9187b3dc-671e-46af-ae6a-9a51f31071e5 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:30.430206 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-9187b3dc-671e-46af-ae6a-9a51f31071e5 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acbca956188435bbf7de9480600bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85801034a13431ebec2bd7a46843d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:29:30.438292 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-9187b3dc-671e-46af-ae6a-9a51f31071e5 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] 10.222.0.113 "GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6" status: 200 len: 1559 microversion: 2.1 time: 0.153254 Jan 24 09:29:30.439086 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 644/1291] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:29:30 2022] GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:29:31.455682 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-d940c557-cdd6-41ac-8259-0bb53eae9cc9 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:29:31.456334 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-d940c557-cdd6-41ac-8259-0bb53eae9cc9 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] [instance: caa08f39-54c9-4b4c-8c4d-03ebefd457f6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:29:31.462633 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d940c557-cdd6-41ac-8259-0bb53eae9cc9 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:31.463084 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d940c557-cdd6-41ac-8259-0bb53eae9cc9 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:31.463867 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d940c557-cdd6-41ac-8259-0bb53eae9cc9 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:31.464304 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d940c557-cdd6-41ac-8259-0bb53eae9cc9 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:31.598371 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-d940c557-cdd6-41ac-8259-0bb53eae9cc9 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acbca956188435bbf7de9480600bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85801034a13431ebec2bd7a46843d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:29:31.605706 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-d940c557-cdd6-41ac-8259-0bb53eae9cc9 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] 10.222.0.113 "GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6" status: 200 len: 1559 microversion: 2.1 time: 0.154581 Jan 24 09:29:31.606300 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 648/1292] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:29:31 2022] GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:29:31.673524 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [req-79f661b5-2637-483b-a277-def9b72df7a8 req-35c26986-2566-4422-b7d2-0fdfcc97c9bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caa08f39-54c9-4b4c-8c4d-03ebefd457f6", "name": "network-vif-deleted", "tag": "07a87910-5cf2-42f0-b095-d0bea4cd1a88"}]} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:29:31.675147 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:29:31.675147 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: warnings.warn(msg) Jan 24 09:29:31.682499 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-79f661b5-2637-483b-a277-def9b72df7a8 req-35c26986-2566-4422-b7d2-0fdfcc97c9bb service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:31.682942 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-79f661b5-2637-483b-a277-def9b72df7a8 req-35c26986-2566-4422-b7d2-0fdfcc97c9bb service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:31.695363 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.compute.server_external_events [req-79f661b5-2637-483b-a277-def9b72df7a8 req-35c26986-2566-4422-b7d2-0fdfcc97c9bb service nova] Creating event network-vif-deleted:07a87910-5cf2-42f0-b095-d0bea4cd1a88 for instance caa08f39-54c9-4b4c-8c4d-03ebefd457f6 on hv-cinder-80403 Jan 24 09:29:31.700035 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [req-79f661b5-2637-483b-a277-def9b72df7a8 req-35c26986-2566-4422-b7d2-0fdfcc97c9bb service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031076 Jan 24 09:29:31.700607 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 645/1293] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 09:29:32.622527 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-49f17e07-8d14-4f91-b479-25fd9819e431 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:29:32.623249 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-49f17e07-8d14-4f91-b479-25fd9819e431 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] [instance: caa08f39-54c9-4b4c-8c4d-03ebefd457f6] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:29:32.630692 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-49f17e07-8d14-4f91-b479-25fd9819e431 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:32.631144 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-49f17e07-8d14-4f91-b479-25fd9819e431 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:32.632070 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-49f17e07-8d14-4f91-b479-25fd9819e431 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:32.632548 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-49f17e07-8d14-4f91-b479-25fd9819e431 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:32.648969 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.wsgi [None req-49f17e07-8d14-4f91-b479-25fd9819e431 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] HTTP exception thrown: Instance caa08f39-54c9-4b4c-8c4d-03ebefd457f6 could not be found. Jan 24 09:29:32.649579 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-49f17e07-8d14-4f91-b479-25fd9819e431 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Returning 404 to user: Instance caa08f39-54c9-4b4c-8c4d-03ebefd457f6 could not be found. {{(pid=116864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:29:32.650444 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-49f17e07-8d14-4f91-b479-25fd9819e431 tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] 10.222.0.113 "GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6" status: 404 len: 111 microversion: 2.1 time: 0.031847 Jan 24 09:29:32.651590 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 649/1294] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:29:32 2022] GET /compute/v2.1/servers/caa08f39-54c9-4b4c-8c4d-03ebefd457f6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 09:29:32.661562 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-56b5a858-acc7-4e49-bc70-d31d6fe682aa tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] Calling method '.version_select at 0x7f473e760ca0>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:29:32.769040 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-56b5a858-acc7-4e49-bc70-d31d6fe682aa tempest-TestMinimumBasicScenario-1195666018 tempest-TestMinimumBasicScenario-1195666018-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1568865365" status: 202 len: 0 microversion: 2.1 time: 0.112109 Jan 24 09:29:32.769727 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 646/1295] 10.222.0.113 () {58 vars in 1276 bytes} [Mon Jan 24 09:29:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1568865365 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:29:35.146699 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-50f24275-e0dc-4042-b22b-59f493b1ea0e tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:29:35.147243 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-50f24275-e0dc-4042-b22b-59f493b1ea0e tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:29:35.153343 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-50f24275-e0dc-4042-b22b-59f493b1ea0e tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:35.154629 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-50f24275-e0dc-4042-b22b-59f493b1ea0e tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:35.154830 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-50f24275-e0dc-4042-b22b-59f493b1ea0e tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:35.155812 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-50f24275-e0dc-4042-b22b-59f493b1ea0e tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:35.179614 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.objects.instance [None req-50f24275-e0dc-4042-b22b-59f493b1ea0e tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lazy-loading 'flavor' on Instance uuid 07611092-00af-4943-a30a-a3698c2520bf {{(pid=116864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 09:29:35.567337 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-50f24275-e0dc-4042-b22b-59f493b1ea0e tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "POST /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf/action" status: 202 len: 0 microversion: 2.1 time: 0.424274 Jan 24 09:29:35.571258 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 650/1296] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:29:35 2022] POST /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf/action => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:29:35.575837 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-e1818876-4d46-465d-8540-112a8bfea191 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:29:35.576531 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-e1818876-4d46-465d-8540-112a8bfea191 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:29:35.584376 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e1818876-4d46-465d-8540-112a8bfea191 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:35.584801 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e1818876-4d46-465d-8540-112a8bfea191 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:35.585580 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e1818876-4d46-465d-8540-112a8bfea191 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:35.586011 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e1818876-4d46-465d-8540-112a8bfea191 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:35.722244 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-e1818876-4d46-465d-8540-112a8bfea191 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd628baac6cf64ce384d85eb0375b4c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1db64ecaea44e09ecbf80f34523511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:29:35.741094 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-e1818876-4d46-465d-8540-112a8bfea191 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf" status: 200 len: 1569 microversion: 2.1 time: 0.157513 Jan 24 09:29:35.741094 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 647/1297] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:29:35 2022] GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:29:36.748571 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-773ff11a-500f-4bd3-904f-8c0999bb9e4e tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:29:36.749922 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-773ff11a-500f-4bd3-904f-8c0999bb9e4e tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:29:36.756785 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-773ff11a-500f-4bd3-904f-8c0999bb9e4e tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:36.757243 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-773ff11a-500f-4bd3-904f-8c0999bb9e4e tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:36.758858 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-773ff11a-500f-4bd3-904f-8c0999bb9e4e tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:36.758858 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-773ff11a-500f-4bd3-904f-8c0999bb9e4e tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:36.996260 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-773ff11a-500f-4bd3-904f-8c0999bb9e4e tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd628baac6cf64ce384d85eb0375b4c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1db64ecaea44e09ecbf80f34523511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:29:37.004607 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-773ff11a-500f-4bd3-904f-8c0999bb9e4e tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf" status: 200 len: 1569 microversion: 2.1 time: 0.260494 Jan 24 09:29:37.005473 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 651/1298] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:29:36 2022] GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf => generated 1569 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:29:38.031785 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-e8bdc7d8-000a-4dd9-8baf-4c3dd47246f1 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:29:38.031785 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-e8bdc7d8-000a-4dd9-8baf-4c3dd47246f1 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:29:38.035551 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e8bdc7d8-000a-4dd9-8baf-4c3dd47246f1 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:38.036003 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e8bdc7d8-000a-4dd9-8baf-4c3dd47246f1 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:38.036798 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e8bdc7d8-000a-4dd9-8baf-4c3dd47246f1 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:38.037416 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e8bdc7d8-000a-4dd9-8baf-4c3dd47246f1 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:38.271300 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-e8bdc7d8-000a-4dd9-8baf-4c3dd47246f1 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd628baac6cf64ce384d85eb0375b4c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1db64ecaea44e09ecbf80f34523511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:29:38.278921 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-e8bdc7d8-000a-4dd9-8baf-4c3dd47246f1 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf" status: 200 len: 1569 microversion: 2.1 time: 0.254472 Jan 24 09:29:38.279517 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 648/1299] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:29:38 2022] GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf => generated 1569 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:29:39.296461 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-fa828cf0-1ea7-449b-bd97-e7b041bb586d tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:29:39.297177 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-fa828cf0-1ea7-449b-bd97-e7b041bb586d tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:29:39.303583 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fa828cf0-1ea7-449b-bd97-e7b041bb586d tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:39.304035 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fa828cf0-1ea7-449b-bd97-e7b041bb586d tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:39.304825 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fa828cf0-1ea7-449b-bd97-e7b041bb586d tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:39.305261 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-fa828cf0-1ea7-449b-bd97-e7b041bb586d tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:39.447849 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-fa828cf0-1ea7-449b-bd97-e7b041bb586d tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd628baac6cf64ce384d85eb0375b4c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1db64ecaea44e09ecbf80f34523511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:29:39.456268 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-fa828cf0-1ea7-449b-bd97-e7b041bb586d tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf" status: 200 len: 1569 microversion: 2.1 time: 0.163651 Jan 24 09:29:39.456890 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 652/1300] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:29:39 2022] GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:29:40.473285 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-7b36de16-815c-47b4-90ac-f87d2b94354e tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:29:40.474055 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-7b36de16-815c-47b4-90ac-f87d2b94354e tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:29:40.480236 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7b36de16-815c-47b4-90ac-f87d2b94354e tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:40.480706 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7b36de16-815c-47b4-90ac-f87d2b94354e tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:40.481504 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7b36de16-815c-47b4-90ac-f87d2b94354e tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:40.481944 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7b36de16-815c-47b4-90ac-f87d2b94354e tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:40.658948 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-7b36de16-815c-47b4-90ac-f87d2b94354e tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd628baac6cf64ce384d85eb0375b4c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1db64ecaea44e09ecbf80f34523511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:29:40.677528 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-7b36de16-815c-47b4-90ac-f87d2b94354e tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf" status: 200 len: 1569 microversion: 2.1 time: 0.197036 Jan 24 09:29:40.677528 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 649/1301] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:29:40 2022] GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf => generated 1569 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:29:41.689278 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-a4cad349-95f0-47e9-b85c-25babd3561cb tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:29:41.689901 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-a4cad349-95f0-47e9-b85c-25babd3561cb tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:29:41.696151 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a4cad349-95f0-47e9-b85c-25babd3561cb tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:41.696637 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a4cad349-95f0-47e9-b85c-25babd3561cb tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:41.697430 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a4cad349-95f0-47e9-b85c-25babd3561cb tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:41.697881 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-a4cad349-95f0-47e9-b85c-25babd3561cb tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:41.836192 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-a4cad349-95f0-47e9-b85c-25babd3561cb tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd628baac6cf64ce384d85eb0375b4c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1db64ecaea44e09ecbf80f34523511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:29:41.843516 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-a4cad349-95f0-47e9-b85c-25babd3561cb tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf" status: 200 len: 1569 microversion: 2.1 time: 0.158753 Jan 24 09:29:41.844084 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 653/1302] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:29:41 2022] GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:29:42.860906 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-9565967b-9f74-48dc-a5c6-6d31e5a6dba1 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:29:42.861683 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-9565967b-9f74-48dc-a5c6-6d31e5a6dba1 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:29:42.868203 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9565967b-9f74-48dc-a5c6-6d31e5a6dba1 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:42.868655 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9565967b-9f74-48dc-a5c6-6d31e5a6dba1 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:42.869439 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9565967b-9f74-48dc-a5c6-6d31e5a6dba1 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:42.869878 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9565967b-9f74-48dc-a5c6-6d31e5a6dba1 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:43.279496 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-9565967b-9f74-48dc-a5c6-6d31e5a6dba1 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd628baac6cf64ce384d85eb0375b4c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1db64ecaea44e09ecbf80f34523511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:29:43.288051 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-9565967b-9f74-48dc-a5c6-6d31e5a6dba1 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf" status: 200 len: 1569 microversion: 2.1 time: 0.431831 Jan 24 09:29:43.288974 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 650/1303] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:29:42 2022] GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf => generated 1569 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:29:44.305336 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-b731fdb7-9bc2-4cea-80ef-b285ea1160f2 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:29:44.305960 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-b731fdb7-9bc2-4cea-80ef-b285ea1160f2 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:29:44.312586 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b731fdb7-9bc2-4cea-80ef-b285ea1160f2 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:44.313038 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b731fdb7-9bc2-4cea-80ef-b285ea1160f2 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:44.313817 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b731fdb7-9bc2-4cea-80ef-b285ea1160f2 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:44.314286 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-b731fdb7-9bc2-4cea-80ef-b285ea1160f2 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:44.447485 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-b731fdb7-9bc2-4cea-80ef-b285ea1160f2 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd628baac6cf64ce384d85eb0375b4c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1db64ecaea44e09ecbf80f34523511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:29:44.455510 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-b731fdb7-9bc2-4cea-80ef-b285ea1160f2 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf" status: 200 len: 1569 microversion: 2.1 time: 0.154079 Jan 24 09:29:44.456103 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 654/1304] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:29:44 2022] GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:29:45.473011 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-aaf601bb-f312-45d4-b80b-bbb319359874 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:29:45.473620 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-aaf601bb-f312-45d4-b80b-bbb319359874 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:29:45.480002 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-aaf601bb-f312-45d4-b80b-bbb319359874 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:45.480453 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-aaf601bb-f312-45d4-b80b-bbb319359874 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:45.481227 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-aaf601bb-f312-45d4-b80b-bbb319359874 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:45.481664 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-aaf601bb-f312-45d4-b80b-bbb319359874 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:45.612899 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-aaf601bb-f312-45d4-b80b-bbb319359874 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd628baac6cf64ce384d85eb0375b4c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1db64ecaea44e09ecbf80f34523511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:29:45.620379 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-aaf601bb-f312-45d4-b80b-bbb319359874 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf" status: 200 len: 1569 microversion: 2.1 time: 0.151041 Jan 24 09:29:45.621068 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 651/1305] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:29:45 2022] GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:29:46.638162 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-204c60d3-8904-4d4a-b7f2-0f7e260cf40e tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:29:46.638891 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-204c60d3-8904-4d4a-b7f2-0f7e260cf40e tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:29:46.646129 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-204c60d3-8904-4d4a-b7f2-0f7e260cf40e tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:46.646568 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-204c60d3-8904-4d4a-b7f2-0f7e260cf40e tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:46.647342 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-204c60d3-8904-4d4a-b7f2-0f7e260cf40e tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:46.647773 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-204c60d3-8904-4d4a-b7f2-0f7e260cf40e tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:46.782939 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-204c60d3-8904-4d4a-b7f2-0f7e260cf40e tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd628baac6cf64ce384d85eb0375b4c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1db64ecaea44e09ecbf80f34523511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:29:46.790479 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-204c60d3-8904-4d4a-b7f2-0f7e260cf40e tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf" status: 200 len: 1569 microversion: 2.1 time: 0.156178 Jan 24 09:29:46.791057 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 655/1306] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:29:46 2022] GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:29:47.807592 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-ed83c1b6-d66d-451e-bdf5-90d43f19c3d8 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:29:47.808208 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-ed83c1b6-d66d-451e-bdf5-90d43f19c3d8 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:29:47.815396 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ed83c1b6-d66d-451e-bdf5-90d43f19c3d8 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:47.815845 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ed83c1b6-d66d-451e-bdf5-90d43f19c3d8 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:47.816682 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ed83c1b6-d66d-451e-bdf5-90d43f19c3d8 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:47.817121 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ed83c1b6-d66d-451e-bdf5-90d43f19c3d8 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:47.959449 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-ed83c1b6-d66d-451e-bdf5-90d43f19c3d8 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd628baac6cf64ce384d85eb0375b4c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1db64ecaea44e09ecbf80f34523511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:29:47.966984 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-ed83c1b6-d66d-451e-bdf5-90d43f19c3d8 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf" status: 200 len: 1569 microversion: 2.1 time: 0.163210 Jan 24 09:29:47.967563 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 652/1307] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:29:47 2022] GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:29:48.984064 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-41b2abf5-4729-45ec-943f-2dc2794f4839 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:29:48.984778 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-41b2abf5-4729-45ec-943f-2dc2794f4839 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:29:48.991307 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-41b2abf5-4729-45ec-943f-2dc2794f4839 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:48.991762 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-41b2abf5-4729-45ec-943f-2dc2794f4839 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:48.992583 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-41b2abf5-4729-45ec-943f-2dc2794f4839 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:48.993028 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-41b2abf5-4729-45ec-943f-2dc2794f4839 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:49.124708 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-41b2abf5-4729-45ec-943f-2dc2794f4839 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd628baac6cf64ce384d85eb0375b4c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1db64ecaea44e09ecbf80f34523511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:29:49.132511 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-41b2abf5-4729-45ec-943f-2dc2794f4839 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf" status: 200 len: 1570 microversion: 2.1 time: 0.152393 Jan 24 09:29:49.133078 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 656/1308] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:29:48 2022] GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:29:49.150308 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-784a8708-0c80-4377-93f3-1da868ef9c15 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:29:49.150935 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-784a8708-0c80-4377-93f3-1da868ef9c15 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:29:49.157720 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-784a8708-0c80-4377-93f3-1da868ef9c15 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:49.158201 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-784a8708-0c80-4377-93f3-1da868ef9c15 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:49.159153 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-784a8708-0c80-4377-93f3-1da868ef9c15 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:49.159609 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-784a8708-0c80-4377-93f3-1da868ef9c15 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:49.427370 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-784a8708-0c80-4377-93f3-1da868ef9c15 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "POST /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf/action" status: 202 len: 0 microversion: 2.1 time: 0.281366 Jan 24 09:29:49.428289 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 653/1309] 10.222.0.113 () {60 vars in 1282 bytes} [Mon Jan 24 09:29:49 2022] POST /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:29:49.436937 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-06c548a5-4317-4893-93eb-28ab99efedfa tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:29:49.437616 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-06c548a5-4317-4893-93eb-28ab99efedfa tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:29:49.447241 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-06c548a5-4317-4893-93eb-28ab99efedfa tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:49.447707 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-06c548a5-4317-4893-93eb-28ab99efedfa tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:49.448512 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-06c548a5-4317-4893-93eb-28ab99efedfa tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:49.448956 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-06c548a5-4317-4893-93eb-28ab99efedfa tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:49.588356 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-06c548a5-4317-4893-93eb-28ab99efedfa tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd628baac6cf64ce384d85eb0375b4c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1db64ecaea44e09ecbf80f34523511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:29:49.599487 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-06c548a5-4317-4893-93eb-28ab99efedfa tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf" status: 200 len: 1578 microversion: 2.1 time: 0.162642 Jan 24 09:29:49.599487 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 657/1310] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:29:49 2022] GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 09:29:50.614704 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-ba61500c-6373-45b0-86d8-640ba17f0cfe tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:29:50.615321 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-ba61500c-6373-45b0-86d8-640ba17f0cfe tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:29:50.621420 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ba61500c-6373-45b0-86d8-640ba17f0cfe tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:50.621943 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ba61500c-6373-45b0-86d8-640ba17f0cfe tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:50.622760 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ba61500c-6373-45b0-86d8-640ba17f0cfe tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:50.623214 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-ba61500c-6373-45b0-86d8-640ba17f0cfe tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:50.759943 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-ba61500c-6373-45b0-86d8-640ba17f0cfe tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd628baac6cf64ce384d85eb0375b4c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1db64ecaea44e09ecbf80f34523511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:29:50.767263 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-ba61500c-6373-45b0-86d8-640ba17f0cfe tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf" status: 200 len: 1520 microversion: 2.1 time: 0.158128 Jan 24 09:29:50.768497 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 654/1311] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:29:50 2022] GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:29:51.603530 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [req-59fdcaca-30e9-48b4-8af9-c60803d6a8a1 req-6392c435-23de-453f-add3-41b99bc63f8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07611092-00af-4943-a30a-a3698c2520bf", "name": "network-vif-unplugged", "status": "completed", "tag": "db0bed25-3789-4a53-af4c-4e01c8044a1e"}]} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:29:51.605095 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:29:51.605095 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: warnings.warn(msg) Jan 24 09:29:51.612447 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-59fdcaca-30e9-48b4-8af9-c60803d6a8a1 req-6392c435-23de-453f-add3-41b99bc63f8c service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:51.613233 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-59fdcaca-30e9-48b4-8af9-c60803d6a8a1 req-6392c435-23de-453f-add3-41b99bc63f8c service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:51.624237 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.compute.server_external_events [req-59fdcaca-30e9-48b4-8af9-c60803d6a8a1 req-6392c435-23de-453f-add3-41b99bc63f8c service nova] Unable to find a host for instance 07611092-00af-4943-a30a-a3698c2520bf. Dropping event network-vif-unplugged {{(pid=116864) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 24 09:29:51.625278 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [req-59fdcaca-30e9-48b4-8af9-c60803d6a8a1 req-6392c435-23de-453f-add3-41b99bc63f8c service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.142153 Jan 24 09:29:51.625858 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 658/1312] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:29:51 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 143 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jan 24 09:29:51.784713 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-75ac8b7a-56a5-4690-816c-b66c68212d5b tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:29:51.785273 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-75ac8b7a-56a5-4690-816c-b66c68212d5b tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:29:51.791640 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-75ac8b7a-56a5-4690-816c-b66c68212d5b tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:51.792092 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-75ac8b7a-56a5-4690-816c-b66c68212d5b tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:51.792868 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-75ac8b7a-56a5-4690-816c-b66c68212d5b tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:51.793309 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-75ac8b7a-56a5-4690-816c-b66c68212d5b tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:51.928202 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-75ac8b7a-56a5-4690-816c-b66c68212d5b tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd628baac6cf64ce384d85eb0375b4c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1db64ecaea44e09ecbf80f34523511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:29:51.936485 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-75ac8b7a-56a5-4690-816c-b66c68212d5b tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf" status: 200 len: 1520 microversion: 2.1 time: 0.155547 Jan 24 09:29:51.937062 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 655/1313] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:29:51 2022] GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:29:52.953908 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-30a4b056-3ea1-40d7-a6b8-37083568ab3f tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:29:52.954563 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-30a4b056-3ea1-40d7-a6b8-37083568ab3f tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:29:52.961026 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-30a4b056-3ea1-40d7-a6b8-37083568ab3f tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:52.961481 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-30a4b056-3ea1-40d7-a6b8-37083568ab3f tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:52.962295 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-30a4b056-3ea1-40d7-a6b8-37083568ab3f tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:52.962739 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-30a4b056-3ea1-40d7-a6b8-37083568ab3f tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:53.107257 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-30a4b056-3ea1-40d7-a6b8-37083568ab3f tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd628baac6cf64ce384d85eb0375b4c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1db64ecaea44e09ecbf80f34523511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:29:53.115514 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-30a4b056-3ea1-40d7-a6b8-37083568ab3f tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf" status: 200 len: 1576 microversion: 2.1 time: 0.165388 Jan 24 09:29:53.116086 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 659/1314] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:29:52 2022] GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:29:54.133127 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-cc762d93-2a3e-4ee4-b9ad-e14f19e5f876 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:29:54.133743 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-cc762d93-2a3e-4ee4-b9ad-e14f19e5f876 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:29:54.140371 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-cc762d93-2a3e-4ee4-b9ad-e14f19e5f876 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:54.140813 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-cc762d93-2a3e-4ee4-b9ad-e14f19e5f876 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:54.141650 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-cc762d93-2a3e-4ee4-b9ad-e14f19e5f876 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:54.142120 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-cc762d93-2a3e-4ee4-b9ad-e14f19e5f876 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:54.277196 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-cc762d93-2a3e-4ee4-b9ad-e14f19e5f876 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd628baac6cf64ce384d85eb0375b4c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1db64ecaea44e09ecbf80f34523511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:29:54.284511 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-cc762d93-2a3e-4ee4-b9ad-e14f19e5f876 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf" status: 200 len: 1576 microversion: 2.1 time: 0.155810 Jan 24 09:29:54.285803 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 656/1315] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:29:54 2022] GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:29:55.304304 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-4e4a1d66-2111-41e3-8240-87bae7bd9cef tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:29:55.304923 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-4e4a1d66-2111-41e3-8240-87bae7bd9cef tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:29:55.311314 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4e4a1d66-2111-41e3-8240-87bae7bd9cef tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:55.311750 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4e4a1d66-2111-41e3-8240-87bae7bd9cef tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:55.312515 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4e4a1d66-2111-41e3-8240-87bae7bd9cef tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:55.312944 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-4e4a1d66-2111-41e3-8240-87bae7bd9cef tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:55.450275 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-4e4a1d66-2111-41e3-8240-87bae7bd9cef tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd628baac6cf64ce384d85eb0375b4c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1db64ecaea44e09ecbf80f34523511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:29:55.457704 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-4e4a1d66-2111-41e3-8240-87bae7bd9cef tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf" status: 200 len: 1576 microversion: 2.1 time: 0.157795 Jan 24 09:29:55.458383 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 660/1316] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:29:55 2022] GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:29:56.475446 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-9786e6dd-d48c-450b-8c5b-d833b6dbc94b tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:29:56.476034 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-9786e6dd-d48c-450b-8c5b-d833b6dbc94b tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:29:56.482638 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9786e6dd-d48c-450b-8c5b-d833b6dbc94b tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:56.483089 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9786e6dd-d48c-450b-8c5b-d833b6dbc94b tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:56.483873 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9786e6dd-d48c-450b-8c5b-d833b6dbc94b tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:56.484306 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9786e6dd-d48c-450b-8c5b-d833b6dbc94b tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:56.620584 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-9786e6dd-d48c-450b-8c5b-d833b6dbc94b tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd628baac6cf64ce384d85eb0375b4c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1db64ecaea44e09ecbf80f34523511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:29:56.627958 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-9786e6dd-d48c-450b-8c5b-d833b6dbc94b tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf" status: 200 len: 1576 microversion: 2.1 time: 0.157005 Jan 24 09:29:56.628565 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 657/1317] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:29:56 2022] GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:29:57.645359 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-1f2eadf7-a7cc-4a2f-8176-f622a93e4b5e tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:29:57.645978 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-1f2eadf7-a7cc-4a2f-8176-f622a93e4b5e tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:29:57.652586 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1f2eadf7-a7cc-4a2f-8176-f622a93e4b5e tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:57.653037 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1f2eadf7-a7cc-4a2f-8176-f622a93e4b5e tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:57.653841 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1f2eadf7-a7cc-4a2f-8176-f622a93e4b5e tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:57.654292 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-1f2eadf7-a7cc-4a2f-8176-f622a93e4b5e tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:57.787361 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-1f2eadf7-a7cc-4a2f-8176-f622a93e4b5e tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd628baac6cf64ce384d85eb0375b4c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1db64ecaea44e09ecbf80f34523511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:29:57.794642 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-1f2eadf7-a7cc-4a2f-8176-f622a93e4b5e tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf" status: 200 len: 1576 microversion: 2.1 time: 0.153752 Jan 24 09:29:57.795212 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 661/1318] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:29:57 2022] GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:29:58.811431 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-9b6cc667-f7aa-413f-b795-baf0be4b4fc0 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:29:58.812079 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-9b6cc667-f7aa-413f-b795-baf0be4b4fc0 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:29:58.819040 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9b6cc667-f7aa-413f-b795-baf0be4b4fc0 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:58.819486 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9b6cc667-f7aa-413f-b795-baf0be4b4fc0 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:58.820266 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9b6cc667-f7aa-413f-b795-baf0be4b4fc0 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:58.820702 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-9b6cc667-f7aa-413f-b795-baf0be4b4fc0 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:58.956081 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-9b6cc667-f7aa-413f-b795-baf0be4b4fc0 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd628baac6cf64ce384d85eb0375b4c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1db64ecaea44e09ecbf80f34523511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:29:58.964121 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-9b6cc667-f7aa-413f-b795-baf0be4b4fc0 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf" status: 200 len: 1576 microversion: 2.1 time: 0.156262 Jan 24 09:29:58.964688 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 658/1319] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:29:58 2022] GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:29:59.981627 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-f461f608-fcaa-4c59-ab8c-121776d7f7da tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:29:59.982272 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-f461f608-fcaa-4c59-ab8c-121776d7f7da tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:29:59.989058 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f461f608-fcaa-4c59-ab8c-121776d7f7da tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:59.989592 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f461f608-fcaa-4c59-ab8c-121776d7f7da tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:29:59.990408 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f461f608-fcaa-4c59-ab8c-121776d7f7da tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:29:59.990850 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-f461f608-fcaa-4c59-ab8c-121776d7f7da tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:30:00.127280 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-f461f608-fcaa-4c59-ab8c-121776d7f7da tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd628baac6cf64ce384d85eb0375b4c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1db64ecaea44e09ecbf80f34523511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:30:00.135441 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-f461f608-fcaa-4c59-ab8c-121776d7f7da tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf" status: 200 len: 1576 microversion: 2.1 time: 0.157441 Jan 24 09:30:00.136011 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 662/1320] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:29:59 2022] GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:30:01.154279 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-7a70c42d-2dc9-4a2a-8daf-e79b62d0ab90 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:30:01.154915 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-7a70c42d-2dc9-4a2a-8daf-e79b62d0ab90 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:30:01.161840 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7a70c42d-2dc9-4a2a-8daf-e79b62d0ab90 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:30:01.162421 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7a70c42d-2dc9-4a2a-8daf-e79b62d0ab90 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:30:01.163198 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7a70c42d-2dc9-4a2a-8daf-e79b62d0ab90 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:30:01.163631 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-7a70c42d-2dc9-4a2a-8daf-e79b62d0ab90 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:30:01.294611 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-7a70c42d-2dc9-4a2a-8daf-e79b62d0ab90 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd628baac6cf64ce384d85eb0375b4c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1db64ecaea44e09ecbf80f34523511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:30:01.302132 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-7a70c42d-2dc9-4a2a-8daf-e79b62d0ab90 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf" status: 200 len: 1576 microversion: 2.1 time: 0.151787 Jan 24 09:30:01.302711 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 659/1321] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:30:01 2022] GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:30:02.319689 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-65f28ecd-8bea-48f9-b9be-39ed0a031ab2 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:30:02.320330 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-65f28ecd-8bea-48f9-b9be-39ed0a031ab2 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:30:02.326636 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-65f28ecd-8bea-48f9-b9be-39ed0a031ab2 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:30:02.327087 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-65f28ecd-8bea-48f9-b9be-39ed0a031ab2 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:30:02.327868 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-65f28ecd-8bea-48f9-b9be-39ed0a031ab2 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:30:02.328306 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-65f28ecd-8bea-48f9-b9be-39ed0a031ab2 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:30:02.462786 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-65f28ecd-8bea-48f9-b9be-39ed0a031ab2 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd628baac6cf64ce384d85eb0375b4c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1db64ecaea44e09ecbf80f34523511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:30:02.471347 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-65f28ecd-8bea-48f9-b9be-39ed0a031ab2 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf" status: 200 len: 1576 microversion: 2.1 time: 0.155940 Jan 24 09:30:02.471919 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 663/1322] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:30:02 2022] GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:30:03.488692 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-e815b04c-b7c0-4b8b-bc43-67614ace7527 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:30:03.489413 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-e815b04c-b7c0-4b8b-bc43-67614ace7527 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:30:03.496725 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e815b04c-b7c0-4b8b-bc43-67614ace7527 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:30:03.497175 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e815b04c-b7c0-4b8b-bc43-67614ace7527 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:30:03.498384 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e815b04c-b7c0-4b8b-bc43-67614ace7527 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:30:03.498507 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-e815b04c-b7c0-4b8b-bc43-67614ace7527 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:30:03.586216 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [req-88b216fe-9820-403f-874e-d2aaddf3e4fd req-4d3141da-c4b6-4888-ae4f-6ee00d472f59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07611092-00af-4943-a30a-a3698c2520bf", "name": "network-vif-plugged", "status": "completed", "tag": "db0bed25-3789-4a53-af4c-4e01c8044a1e"}]} {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:30:03.587819 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:30:03.587819 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: warnings.warn(msg) Jan 24 09:30:03.595786 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-88b216fe-9820-403f-874e-d2aaddf3e4fd req-4d3141da-c4b6-4888-ae4f-6ee00d472f59 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:30:03.596234 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [req-88b216fe-9820-403f-874e-d2aaddf3e4fd req-4d3141da-c4b6-4888-ae4f-6ee00d472f59 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:30:03.607924 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.compute.server_external_events [req-88b216fe-9820-403f-874e-d2aaddf3e4fd req-4d3141da-c4b6-4888-ae4f-6ee00d472f59 service nova] Creating event network-vif-plugged:db0bed25-3789-4a53-af4c-4e01c8044a1e for instance 07611092-00af-4943-a30a-a3698c2520bf on hv-cinder-80403 Jan 24 09:30:03.613232 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [req-88b216fe-9820-403f-874e-d2aaddf3e4fd req-4d3141da-c4b6-4888-ae4f-6ee00d472f59 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031351 Jan 24 09:30:03.613867 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 664/1323] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 09:30:03.643989 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-e815b04c-b7c0-4b8b-bc43-67614ace7527 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd628baac6cf64ce384d85eb0375b4c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1db64ecaea44e09ecbf80f34523511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:30:03.652706 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-e815b04c-b7c0-4b8b-bc43-67614ace7527 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf" status: 200 len: 1576 microversion: 2.1 time: 0.167598 Jan 24 09:30:03.653305 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 660/1324] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:30:03 2022] GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:30:04.669724 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-669ee998-6f6f-4904-960e-3555cb12de3c tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:30:04.670460 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-669ee998-6f6f-4904-960e-3555cb12de3c tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:30:04.676649 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-669ee998-6f6f-4904-960e-3555cb12de3c tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:30:04.677096 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-669ee998-6f6f-4904-960e-3555cb12de3c tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:30:04.677922 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-669ee998-6f6f-4904-960e-3555cb12de3c tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:30:04.678404 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-669ee998-6f6f-4904-960e-3555cb12de3c tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:30:04.810921 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-669ee998-6f6f-4904-960e-3555cb12de3c tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd628baac6cf64ce384d85eb0375b4c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1db64ecaea44e09ecbf80f34523511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:30:04.820096 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-669ee998-6f6f-4904-960e-3555cb12de3c tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf" status: 200 len: 1576 microversion: 2.1 time: 0.154577 Jan 24 09:30:04.820656 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 665/1325] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:30:04 2022] GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:30:05.838571 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-365025f3-c392-44e6-8f45-0b80791d2189 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:30:05.839352 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-365025f3-c392-44e6-8f45-0b80791d2189 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:30:05.845306 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-365025f3-c392-44e6-8f45-0b80791d2189 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:30:05.845778 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-365025f3-c392-44e6-8f45-0b80791d2189 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:30:05.846596 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-365025f3-c392-44e6-8f45-0b80791d2189 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:30:05.847033 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-365025f3-c392-44e6-8f45-0b80791d2189 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:30:05.993210 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-365025f3-c392-44e6-8f45-0b80791d2189 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd628baac6cf64ce384d85eb0375b4c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1db64ecaea44e09ecbf80f34523511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:30:06.001233 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-365025f3-c392-44e6-8f45-0b80791d2189 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf" status: 200 len: 1563 microversion: 2.1 time: 0.167802 Jan 24 09:30:06.001849 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 661/1326] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:30:05 2022] GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf => generated 1563 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:30:52.029971 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 24 09:30:52.030627 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: Mon Jan 24 09:30:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 24 09:31:26.481705 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-092c5eb4-33d9-4962-9354-6ec2c61465b8 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:31:26.482387 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-092c5eb4-33d9-4962-9354-6ec2c61465b8 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:31:26.485007 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [req-9b2d8a47-cebe-4e4d-9d16-ec3bdb561e70 req-55b02cd9-3367-4462-a94e-cf225bf9b3c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07611092-00af-4943-a30a-a3698c2520bf", "tag": "db0bed25-3789-4a53-af4c-4e01c8044a1e"}]} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:31:26.486565 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:31:26.486565 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: warnings.warn(msg) Jan 24 09:31:26.490181 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-092c5eb4-33d9-4962-9354-6ec2c61465b8 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:31:26.490640 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-092c5eb4-33d9-4962-9354-6ec2c61465b8 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:31:26.491444 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-092c5eb4-33d9-4962-9354-6ec2c61465b8 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:31:26.491885 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-092c5eb4-33d9-4962-9354-6ec2c61465b8 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:31:26.493629 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-9b2d8a47-cebe-4e4d-9d16-ec3bdb561e70 req-55b02cd9-3367-4462-a94e-cf225bf9b3c4 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:31:26.494073 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-9b2d8a47-cebe-4e4d-9d16-ec3bdb561e70 req-55b02cd9-3367-4462-a94e-cf225bf9b3c4 service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:31:26.507432 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.compute.server_external_events [req-9b2d8a47-cebe-4e4d-9d16-ec3bdb561e70 req-55b02cd9-3367-4462-a94e-cf225bf9b3c4 service nova] Creating event network-changed:db0bed25-3789-4a53-af4c-4e01c8044a1e for instance 07611092-00af-4943-a30a-a3698c2520bf on hv-cinder-80403 Jan 24 09:31:26.512606 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [req-9b2d8a47-cebe-4e4d-9d16-ec3bdb561e70 req-55b02cd9-3367-4462-a94e-cf225bf9b3c4 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031996 Jan 24 09:31:26.513786 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 662/1327] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 09:31:26.520611 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-092c5eb4-33d9-4962-9354-6ec2c61465b8 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Going to try to terminate instance {{(pid=116864) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 09:31:26.827008 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-092c5eb4-33d9-4962-9354-6ec2c61465b8 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "DELETE /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf" status: 204 len: 0 microversion: 2.1 time: 0.349499 Jan 24 09:31:26.828037 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 666/1328] 10.222.0.113 () {58 vars in 1243 bytes} [Mon Jan 24 09:31:26 2022] DELETE /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 24 09:31:26.838046 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-2c343a5f-d374-47d3-9bba-c02734bab9c1 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:31:26.839425 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-2c343a5f-d374-47d3-9bba-c02734bab9c1 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:31:26.846007 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-2c343a5f-d374-47d3-9bba-c02734bab9c1 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:31:26.846491 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-2c343a5f-d374-47d3-9bba-c02734bab9c1 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:31:26.847284 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-2c343a5f-d374-47d3-9bba-c02734bab9c1 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:31:26.848720 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-2c343a5f-d374-47d3-9bba-c02734bab9c1 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:31:27.100639 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-2c343a5f-d374-47d3-9bba-c02734bab9c1 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd628baac6cf64ce384d85eb0375b4c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1db64ecaea44e09ecbf80f34523511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:31:27.108140 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-2c343a5f-d374-47d3-9bba-c02734bab9c1 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf" status: 200 len: 1569 microversion: 2.1 time: 0.274431 Jan 24 09:31:27.108641 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 663/1329] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:31:26 2022] GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf => generated 1569 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:31:28.125390 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-d6cc9809-dc4f-4a10-9cab-2ea901b9a507 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:31:28.126115 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-d6cc9809-dc4f-4a10-9cab-2ea901b9a507 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:31:28.133648 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d6cc9809-dc4f-4a10-9cab-2ea901b9a507 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:31:28.134122 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d6cc9809-dc4f-4a10-9cab-2ea901b9a507 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:31:28.134908 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d6cc9809-dc4f-4a10-9cab-2ea901b9a507 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:31:28.135349 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d6cc9809-dc4f-4a10-9cab-2ea901b9a507 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:31:28.270583 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-d6cc9809-dc4f-4a10-9cab-2ea901b9a507 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd628baac6cf64ce384d85eb0375b4c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1db64ecaea44e09ecbf80f34523511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:31:28.278372 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-d6cc9809-dc4f-4a10-9cab-2ea901b9a507 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf" status: 200 len: 1450 microversion: 2.1 time: 0.156979 Jan 24 09:31:28.278948 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 667/1330] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:31:28 2022] GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:31:29.219633 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [req-3709823d-3f7b-4014-8ff0-6a22a427516b req-5699a1db-a8cb-44fe-8d69-1193517a956a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07611092-00af-4943-a30a-a3698c2520bf", "name": "network-vif-deleted", "tag": "db0bed25-3789-4a53-af4c-4e01c8044a1e"}]} {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 09:31:29.221512 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 09:31:29.221512 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: warnings.warn(msg) Jan 24 09:31:29.230730 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-3709823d-3f7b-4014-8ff0-6a22a427516b req-5699a1db-a8cb-44fe-8d69-1193517a956a service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:31:29.231172 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [req-3709823d-3f7b-4014-8ff0-6a22a427516b req-5699a1db-a8cb-44fe-8d69-1193517a956a service nova] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:31:29.242958 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.compute.server_external_events [req-3709823d-3f7b-4014-8ff0-6a22a427516b req-5699a1db-a8cb-44fe-8d69-1193517a956a service nova] Creating event network-vif-deleted:db0bed25-3789-4a53-af4c-4e01c8044a1e for instance 07611092-00af-4943-a30a-a3698c2520bf on hv-cinder-80403 Jan 24 09:31:29.247923 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [req-3709823d-3f7b-4014-8ff0-6a22a427516b req-5699a1db-a8cb-44fe-8d69-1193517a956a service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032200 Jan 24 09:31:29.248509 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 664/1331] 10.222.0.113 () {64 vars in 1322 bytes} [Mon Jan 24 09:31:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 09:31:29.295964 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-10908f4c-2ae7-4f3b-bcb5-f23f5aa193ad tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:31:29.296607 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-10908f4c-2ae7-4f3b-bcb5-f23f5aa193ad tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:31:29.303892 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-10908f4c-2ae7-4f3b-bcb5-f23f5aa193ad tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:31:29.304426 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-10908f4c-2ae7-4f3b-bcb5-f23f5aa193ad tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:31:29.305150 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-10908f4c-2ae7-4f3b-bcb5-f23f5aa193ad tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:31:29.305593 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-10908f4c-2ae7-4f3b-bcb5-f23f5aa193ad tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:31:29.365362 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.policy [None req-10908f4c-2ae7-4f3b-bcb5-f23f5aa193ad tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd628baac6cf64ce384d85eb0375b4c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1db64ecaea44e09ecbf80f34523511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116864) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:31:29.372818 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-10908f4c-2ae7-4f3b-bcb5-f23f5aa193ad tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf" status: 200 len: 1382 microversion: 2.1 time: 0.080571 Jan 24 09:31:29.373439 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 668/1332] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:31:29 2022] GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf => generated 1382 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:31:30.391150 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-64a9a020-d054-41f6-8aa1-39767f0a6d1d tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Calling method '>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:31:30.391848 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.compute.api [None req-64a9a020-d054-41f6-8aa1-39767f0a6d1d tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Fetching instance by UUID {{(pid=116863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:31:30.399038 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-64a9a020-d054-41f6-8aa1-39767f0a6d1d tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:31:30.399482 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-64a9a020-d054-41f6-8aa1-39767f0a6d1d tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:31:30.400265 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-64a9a020-d054-41f6-8aa1-39767f0a6d1d tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:31:30.400695 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-64a9a020-d054-41f6-8aa1-39767f0a6d1d tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:31:30.433399 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-64a9a020-d054-41f6-8aa1-39767f0a6d1d tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:31:30.433839 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG oslo_concurrency.lockutils [None req-64a9a020-d054-41f6-8aa1-39767f0a6d1d tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:31:30.434315 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.objects.instance [None req-64a9a020-d054-41f6-8aa1-39767f0a6d1d tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lazy-loading 'fault' on Instance uuid 07611092-00af-4943-a30a-a3698c2520bf {{(pid=116863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 09:31:30.476833 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.policy [None req-64a9a020-d054-41f6-8aa1-39767f0a6d1d tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd628baac6cf64ce384d85eb0375b4c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1db64ecaea44e09ecbf80f34523511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 09:31:30.484491 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-64a9a020-d054-41f6-8aa1-39767f0a6d1d tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf" status: 200 len: 1225 microversion: 2.1 time: 0.097504 Jan 24 09:31:30.485099 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 665/1333] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:31:30 2022] GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 09:31:31.501437 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-d90a82e8-0a56-4c01-b3c8-97901cfb8081 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Calling method '>' {{(pid=116864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:31:31.502048 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.compute.api [None req-d90a82e8-0a56-4c01-b3c8-97901cfb8081 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] [instance: 07611092-00af-4943-a30a-a3698c2520bf] Fetching instance by UUID {{(pid=116864) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 09:31:31.509274 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d90a82e8-0a56-4c01-b3c8-97901cfb8081 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:31:31.509722 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d90a82e8-0a56-4c01-b3c8-97901cfb8081 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:31:31.510545 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d90a82e8-0a56-4c01-b3c8-97901cfb8081 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 09:31:31.510985 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG oslo_concurrency.lockutils [None req-d90a82e8-0a56-4c01-b3c8-97901cfb8081 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Lock "3a4ccec5-1fee-4d4a-81eb-6ec950059a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 09:31:31.525886 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.wsgi [None req-d90a82e8-0a56-4c01-b3c8-97901cfb8081 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] HTTP exception thrown: Instance 07611092-00af-4943-a30a-a3698c2520bf could not be found. Jan 24 09:31:31.531135 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: DEBUG nova.api.openstack.wsgi [None req-d90a82e8-0a56-4c01-b3c8-97901cfb8081 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Returning 404 to user: Instance 07611092-00af-4943-a30a-a3698c2520bf could not be found. {{(pid=116864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 09:31:31.531135 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO nova.api.openstack.requestlog [None req-d90a82e8-0a56-4c01-b3c8-97901cfb8081 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf" status: 404 len: 111 microversion: 2.1 time: 0.029646 Jan 24 09:31:31.531135 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: [pid: 116864|app: 0|req: 669/1334] 10.222.0.113 () {58 vars in 1240 bytes} [Mon Jan 24 09:31:31 2022] GET /compute/v2.1/servers/07611092-00af-4943-a30a-a3698c2520bf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 09:31:31.808144 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: DEBUG nova.api.openstack.wsgi [None req-9f8c30bb-4b82-4802-bc25-204c26722d12 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] Calling method '.version_select at 0x7f473e700160>' {{(pid=116863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 09:31:31.918254 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO nova.api.openstack.requestlog [None req-9f8c30bb-4b82-4802-bc25-204c26722d12 tempest-TestShelveInstance-428663437 tempest-TestShelveInstance-428663437-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-755176761" status: 202 len: 0 microversion: 2.1 time: 0.113672 Jan 24 09:31:31.918858 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: [pid: 116863|app: 0|req: 666/1335] 10.222.0.113 () {58 vars in 1255 bytes} [Mon Jan 24 09:31:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-755176761 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 09:32:12.173592 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 24 09:32:12.174550 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: Mon Jan 24 09:32:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 24 09:32:28.324008 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 24 09:32:28.324651 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: Mon Jan 24 09:32:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 24 09:34:03.979362 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 24 09:34:03.979964 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: Mon Jan 24 09:34:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 24 09:34:12.037953 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 24 09:34:12.038623 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: Mon Jan 24 09:34:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 24 09:34:13.591703 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 24 09:34:13.592519 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: Mon Jan 24 09:34:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 24 09:34:37.876526 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 24 09:34:37.877156 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: Mon Jan 24 09:34:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 24 09:35:32.182919 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 24 09:35:32.183703 dv-cinder-804035-26-iscsi devstack@n-api.service[116863]: Mon Jan 24 09:35:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 24 09:35:48.332481 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 24 09:35:48.333116 dv-cinder-804035-26-iscsi devstack@n-api.service[116864]: Mon Jan 24 09:35:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!